» Tag
text-to-sql
3 postsGenerating the database from the answer key in text-to-SQL benchmarks
A UIUC audit found over half of BIRD and Spider 2.0 annotations wrong. One developer inverted the process: declare the answer first, then generate a database that satisfies it.
A Deterministic Guard Stops LLM Agents From SQL Overfetching
An open-source, LLM-free guard checks agent-generated SQL against user roles before execution, preventing text-to-SQL systems from overfetching sensitive data.
Text-to-SQL Fails Because of Your Warehouse, Not the Model
Text-to-SQL accuracy collapses on real enterprise warehouses despite strong benchmark scores. Evidence points to undocumented schemas, not model quality, as the cause.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.com