» Tag
latency
4 posts«August 2026
Prefill/Decode Disaggregation Can Worsen Tail Latency, Not Fix It
Splitting prefill and decode across GPU pools adds queues and KV transfer overhead that can worsen tail latency without careful control-loop design.
Hiding Memory Latency in eBPF: Solutions to Avoid Stalling
Exploring methods to hide memory latency with eBPF and its importance for engineers.
Indexing the Data Lake for Online Point Queries
Spotify and others leverage RAP to optimize point queries in data lakes.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comMeasuring Apple M4 Cache Latency Using Rust
A Rust microbenchmark was used to measure cache latency in the Apple M4 processor. Results validate the L1 and L2 structure.