» Tag
benchmarking
10 postsNew Verifier Exposes Hidden Bugs in LLM-Generated GPU Kernels
A 12-gate contract verifier finds that 39.5% of LLM-generated GPU kernels are broken despite passing standard correctness benchmarks.
MCP Sessions Moved Into the Payload: Sticky, Redis, Continuations Compared
MCP dropped server sessions for MRTR; a Rust rmcp v3 benchmark measures sticky, Redis, and sealed-continuation state strategies.
nibble: Diagnose and Fix Redis Memory Waste, No Install Required
nibble diagnoses and fixes Redis memory waste with zero install, claiming an 8.6x memory reduction backed by transparent, documented benchmarks.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comPrefill/Decode Disaggregation Can Worsen Tail Latency, Not Fix It
Splitting prefill and decode across GPU pools adds queues and KV transfer overhead that can worsen tail latency without careful control-loop design.
A Playground Created for 110 Database Systems
An interactive playground for 110 database systems allows users to run queries and compare results.
Vero: Can AI Agents Build Formally Verified Software Repositories?
Vero benchmarks AI agents' capabilities in joint implementation and proof synthesis for software repositories.
Performance of WebAssembly Runtimes in 2026
2026 benchmarks show Wasmer as the top WebAssembly runtime, with WAVM optimizing effectively.
Exploring Database Internals with Rust: Measured Insights
A curriculum on database internals using Rust benchmarks for hands-on learning. Explore 44 topics with measurable insights.
Benchmarking LLMs in File System Design and Implementation
The Bench framework evaluates LLM performance in file system development with 505 tasks, highlighting capabilities and failure mitigation.
Testing LLM Concurrency on Consumer Hardware (RTX 5060)
LLM concurrency tests on RTX 5060 yield crucial insights for engineers.