» Tag
ai
42 postsJuly 2026
AI Inference Engineering: Inside the Prefill-Decode Split
A technical look at how LLM inference splits into compute-bound prefill and memory-bound decode phases, and the optimization techniques engineers use to scale them.
Reading Agent Traces Reveals What Evals Can't Decide
An agent built for AI Engineer World's Fair invented fake speakers. Reading agent traces, not evals, caught it—key lessons on model choice, cost, and observability for engineers.