» Tag
infrastructure
72 postsAI Inference Engineering: Inside the Prefill-Decode Split
A technical look at how LLM inference splits into compute-bound prefill and memory-bound decode phases, and the optimization techniques engineers use to scale them.
How GitHub's forgotten security rules ended up blocking real users
GitHub reveals how temporary incident-response rules left in place kept quietly blocking legitimate users, highlighting the need for lifecycle management and observability in defense systems.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.com