» Tag
llm
473 postsRegex Beats LLM Classifiers by 45 Points in Agent Context Routing
In a new test, plain regex rules beat TF-IDF classifiers by 45 points at routing agent context, showing an LLM call is often unnecessary.
When Fine-Tuning Stalls: The Architecture That Took Recall to 92%
A healthcare claims AI stuck at 45% recall on CPT/ICD coding reached 92% by adding a deterministic NCCI validation layer instead of more fine-tuning.
What Breaks MCP Servers in Production
A look at real production failures in MCP servers—model-unreadable errors, token rotation logouts, schema key rejections, size limits—and the standard built to fix them.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comDeprecated Accessor Trap in AI SDK v7 Silently Erases Agent Memory
In AI SDK v7, result.response.messages now returns only the final step, silently dropping tool calls from history and crippling multi-turn agent behavior in smaller models.
Your LLM Judge Needs a Regression Test Suite
rubric-bench v0.1 is an open-source tool that regression-tests LLM judges against golden sets, catching grading drift in CI before it reaches production.
Local AI Pipelines: Why Some Workloads Should Never Leave
Privacy, cost, and latency push certain AI tasks off the cloud and onto local hardware. A practical local AI pipeline using Ollama and faster-whisper.
Metis: Arm's Open-Source Agentic Security Review Tool
Metis, built by Arm's Product Security Team, is an open-source framework that uses LLM reasoning to find security vulnerabilities across large codebases.
AI Code Audit: 15 Security Flaws Claude Found in Production
An LLM-based security audit uncovered 15 OWASP-classified flaws-SQL/NoSQL injection, IDOR, path traversal-each shown with vulnerable and fixed code.
Agentic AI: Solid Upfront Design Pays Off Later
DumbQuestion.ai's new Startup Roast feature shows how solid upfront architecture saves tokens and time when extending agentic AI products.
Building a Compliance Answer Engine That Refuses to Hallucinate
How a Swiss compliance RAG system uses two-layer retrieval and mandatory citations to structurally block hallucinated numbers and claims.