» Tag
llm
535 postsElpis: A Rust TUI Agent Shell With Per-Turn Context Pruning
Elpis is an open-source Rust TUI agent shell with per-turn context pruning, a visible context ledger, and durable memory for LLM coding agents.
Gigatoken: Rust BPE Tokenizer Hits 24.53 GB/s, Up to 989x Faster
Rust-based Gigatoken hits 24.53 GB/s BPE tokenization using SWAR and dual-cursor techniques, vastly outpacing HuggingFace tokenizers and tiktoken.
Inside Claude Science: How Anthropic's Daemon-Driven Harness Works
A technical breakdown of Claude Science's daemon-mediated host RPC, kernel authority split, and agent-harness architecture.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comOctomind Cloud Launches: Persistent Compute for AI Agents
Octomind Cloud beta unifies AI model access and persistent compute, with transparent per-second billing, Docker support, and 21 curated models.
Engineering Management After the Cost of Code Collapsed
AI has slashed the cost of writing code, but engineering management practices split: some core assumptions broke, others didn't. Here's how to tell which.
PXQ format revives Pascal/Volta GPUs: +88% prefill on a $150 Tesla P100
PXQ format and custom CUDA kernels in ik_llama.cpp fork pxq_llama deliver major prefill/decode speedups on Tesla P100, V100 and GTX 1080 Ti GPUs.
Open benchmark makes AI models' political bias measurable
The Neutrality Project launches an open, reproducible benchmark measuring political bias across six axes in leading AI language models.
Hugging Face Discloses Breach Driven by an Autonomous AI Agent
Hugging Face discloses a breach by an autonomous AI agent, detected via LLM-based analysis after commercial models blocked forensic work.
Building APIs for AI Agents: A Practical Playbook
How crmkit's agent-first API design reshapes conventions: text over JSON, short IDs, bulk operations, and self-documenting endpoints.
When an LLM's Training Data Expires: Fixing a Car Pricing Engine
An AI car-pricing engine broke because its LLM recalled stale exchange rates, revealing risks of mandatory retrieval and cache provenance in LLM apps.