» Tag
llm
53 postsJuly 2026
AI Inference Engineering: Inside the Prefill-Decode Split
A technical look at how LLM inference splits into compute-bound prefill and memory-bound decode phases, and the optimization techniques engineers use to scale them.
Reading Agent Traces Reveals What Evals Can't Decide
An agent built for AI Engineer World's Fair invented fake speakers. Reading agent traces, not evals, caught it—key lessons on model choice, cost, and observability for engineers.
MakerChecker: An Open Source Security Layer for AI Agents
MakerChecker is an open-source toolset that scans for risky actions by AI agents and secures them with permission-based auditing and a signed chain of records.