» Tag
experiments
4 postsMonthly AI Models Buying Question Experiment
Responses from eight AI models to the same buying question each month were analyzed. The results are surprising and inconsistent.
What We Learned from Reproducing 2,200 Papers from ICML 2026
The ICML 2026 hackathon reproduced 2,226 papers, raising questions about AI research reliability.
Testing AI Agents' Compliance with Rules: An Experiment
The results of an experiment testing AI agents' compliance with rules were surprising. Significant data was obtained on the impact of mechanical barriers.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.com900 Data-Agent Runs: Insights on Accuracy, Reproducibility, and Errors
Insights from 900 data-agent runs analyzing accuracy and reproducibility in U.S. farmers markets.