» Tag
llm
483 postsAI Inference Engineering: Inside the Prefill-Decode Split
A technical look at how LLM inference splits into compute-bound prefill and memory-bound decode phases, and the optimization techniques engineers use to scale them.
Reading Agent Traces Reveals What Evals Can't Decide
An agent built for AI Engineer World's Fair invented fake speakers. Reading agent traces, not evals, caught it—key lessons on model choice, cost, and observability for engineers.
MakerChecker: An Open Source Security Layer for AI Agents
MakerChecker is an open-source toolset that scans for risky actions by AI agents and secures them with permission-based auditing and a signed chain of records.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.com