» Tag
statistics
9 posts78,000-Tweet LLM Study Debunks the Trump-Tweet Market-Mover Myth
A 78,000-tweet LLM study tests whether Trump's posts move markets — and uncovers seven statistical bugs before landing on a null result.
Are AI Labs Gaming the Pelican-on-a-Bicycle Benchmark?
A statistical study generates 1,008 SVGs across 7 LLMs to test whether AI labs are secretly optimizing for the famous pelican-on-a-bicycle benchmark.
Randomized KV-Cache Eviction Enables Verifiable Error Certificates
A new paper shows randomized KV-cache eviction, unlike deterministic top-k, enables verifiable per-step error certificates for LLM serving.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comWhy your eval set is too small to catch real regressions
Small eval sets miss most regressions. Learn how statistical power, Wilson intervals, and binary criteria fix eval-driven development.
A Fair Coin Isn't Enough: Why a Randomized Experiment Can Become Unanalyzable
A cryptographically fair coin flip still failed as an experiment: missing join keys, no re-draw guard, and no power calculation made it unanalyzable.
How to Verify if a Benchmark Truly Has a Source
Learn a four-step method to verify the source of a statistic. Enhance the reliability of your data.
PostgreSQL Query Plans: Performance Analysis Without Production Data
Understanding PostgreSQL query plans is critical for identifying discrepancies between test and production data. New methods can enhance performance.
Interesting AI Coding Stats from Cursor
Cursor's new report reveals intriguing statistics on AI coding and user behavior.
Finance engineering roles make up 2.6% of open finance-department jobs
Finance engineering roles constitute 2.6% of open finance department jobs. Explore the significance and employment status of this emerging title.