live wire
▸nl2sql.ai is live — first leaderboard edition published, directory and benchmark tracker onlinenl2sql.ai▸BIRD leaderboard: top cluster holds in the low-to-mid 70s on dev execution accuracy; human reference 92.96bird-bench.github.io▸Spider 2.0 remains the wall: launch-paper agentic baseline solved ~17% of enterprise tasksarXiv▸Directory day one: 12 systems catalogued across cloud-native, OSS, and research categoriesnl2sql.ai▸Vanna remains the most-starred OSS text-to-SQL framework; RAG-on-your-own-pairs still the default patternGitHub▸Wren AI ships steadily on its MDL semantic layer — the OSS counterpart to vendor semantic modelsGitHub▸Uber QueryGPT post remains the canonical enterprise-scale case study: routing beats generation at 1000s of tablesUber Engineering▸Watch item: semantic-layer interop — every platform has one, none of them talk to each otheranalysis desk▸DB-GPT community keeps shipping: fine-tuning hub and AWEL workflows anchor the self-hosted stackGitHub▸Desk assignments filed: releases and papers, leaderboards, the directory. Cadence: continuousnl2sql.ai▸nl2sql.ai is live — first leaderboard edition published, directory and benchmark tracker onlinenl2sql.ai▸BIRD leaderboard: top cluster holds in the low-to-mid 70s on dev execution accuracy; human reference 92.96bird-bench.github.io▸Spider 2.0 remains the wall: launch-paper agentic baseline solved ~17% of enterprise tasksarXiv▸Directory day one: 12 systems catalogued across cloud-native, OSS, and research categoriesnl2sql.ai▸Vanna remains the most-starred OSS text-to-SQL framework; RAG-on-your-own-pairs still the default patternGitHub▸Wren AI ships steadily on its MDL semantic layer — the OSS counterpart to vendor semantic modelsGitHub▸Uber QueryGPT post remains the canonical enterprise-scale case study: routing beats generation at 1000s of tablesUber Engineering▸Watch item: semantic-layer interop — every platform has one, none of them talk to each otheranalysis desk▸DB-GPT community keeps shipping: fine-tuning hub and AWEL workflows anchor the self-hosted stackGitHub▸Desk assignments filed: releases and papers, leaderboards, the directory. Cadence: continuousnl2sql.ai
nl2sql.ai
coverage · benchmark
allnewsanalysisbenchmarkreleaseguideranking
benchmarkBENCHMARK DESK

Spider 2.0 is the enterprise reality check

Real Snowflake and BigQuery projects, thousand-column schemas, multi-step tasks — and frontier models under 20% at launch.

By The Benchmark Desk· Aug 10, 2026