» Tag
llm-testing
2 postsTesting AI Agents: The Bug Hides in the Answer, Not the Trace
An AI agent passed eight straight safety tests, then silently broke one - a case study in why traces, not answers, reveal agent failures.
Severity, Not Flat Pass-Rate, Should Gate Agent Evals
severity_gate.py is an offline, stdlib-only CI tool that gates agent eval runs by failure severity instead of a flat pass-rate, returning SHIP, REVIEW, or BLOCK.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.com