live wire
▸MotherDuck adds image classification and object location to prompt_jev(), returning typed SQL outputs with confidence scoresMotherDuck▸BigQuery conversational analytics adds Montréal and Toronto; mixed-region agents still default to globalGoogle Cloud Documentation▸Fabric enables Azure OpenAI Copilot access by default, but OpenAI-subprocessor and cross-region processing/storage switches remain offMicrosoft Learn▸Snowflake Cortex Agents now continue by default when named tools are inaccessible, emitting warnings instead of failing the runSnowflake documentation▸Databricks Genie One can use group memberships to tailor answers, while Unity Catalog remains the access-control boundaryDatabricks documentation▸Fabric data agents can query Power BI models with Read alone; Build and workspace access are unnecessaryMicrosoft Learn▸Fabric data-agent Git configs expose column flags, but selecting a table still includes every columnMicrosoft Learn▸Google Data Agent Kit offers remote Spark kernels, but notebook exports can still move results into local Pandas or ArrowGoogle Cloud Documentation▸Cube says production analytics agents need explicit partial-result states, caller-filtered model search and durable artifactsCube▸Thinking Machines names Bridgewater behind ReViSQL-K2.6, citing 92.97% SC-16 accuracy at 15% of frontier-model costThinking Machines Lab▸AWS says a mismatched data/tool/prompt release cut its Field Sales agent pass rate from 78% to 38% in pre-productionAWS Artificial Intelligence Blog▸NL2SQL Multi-Agent ships evaluation artifacts across BIRD, CSpider, Archer and KDD DataSpace—but no software licenseGitHub▸Snowflake says Cortex Analyst apps keep working, but recommends Cortex Agents; semantic views and verified queries carry overSnowflake Documentation▸IBM watsonx.governance adds agent runtime-control sync plus Langfuse and Arize metric ingestionIBM watsonx documentation▸MotherDuck adds image classification and object location to prompt_jev(), returning typed SQL outputs with confidence scoresMotherDuck▸BigQuery conversational analytics adds Montréal and Toronto; mixed-region agents still default to globalGoogle Cloud Documentation▸Fabric enables Azure OpenAI Copilot access by default, but OpenAI-subprocessor and cross-region processing/storage switches remain offMicrosoft Learn▸Snowflake Cortex Agents now continue by default when named tools are inaccessible, emitting warnings instead of failing the runSnowflake documentation▸Databricks Genie One can use group memberships to tailor answers, while Unity Catalog remains the access-control boundaryDatabricks documentation▸Fabric data agents can query Power BI models with Read alone; Build and workspace access are unnecessaryMicrosoft Learn▸Fabric data-agent Git configs expose column flags, but selecting a table still includes every columnMicrosoft Learn▸Google Data Agent Kit offers remote Spark kernels, but notebook exports can still move results into local Pandas or ArrowGoogle Cloud Documentation▸Cube says production analytics agents need explicit partial-result states, caller-filtered model search and durable artifactsCube▸Thinking Machines names Bridgewater behind ReViSQL-K2.6, citing 92.97% SC-16 accuracy at 15% of frontier-model costThinking Machines Lab▸AWS says a mismatched data/tool/prompt release cut its Field Sales agent pass rate from 78% to 38% in pre-productionAWS Artificial Intelligence Blog▸NL2SQL Multi-Agent ships evaluation artifacts across BIRD, CSpider, Archer and KDD DataSpace—but no software licenseGitHub▸Snowflake says Cortex Analyst apps keep working, but recommends Cortex Agents; semantic views and verified queries carry overSnowflake Documentation▸IBM watsonx.governance adds agent runtime-control sync plus Langfuse and Arize metric ingestionIBM watsonx documentation
nl2sql.ai

edition 2026-08 · published Aug 10, 2026

The nl2sql.ai Leaderboard — Launch Edition (August 2026)

#systemscoreΔ
1Cortex AnalystSnowflake88.0—
2AI/BI GenieDatabricks86.0—
3SQLCoder / DefogDefog.ai81.0—
4VannaVanna AI79.5—
5Gemini in BigQueryGoogle Cloud78.0—
6WrenAICanner76.5—
7DB-GPTeosphoros-ai74.0—
8Copilot in Microsoft FabricMicrosoft72.5—
methodology

Scores are 0–100, weighted across four pillars:

  • Capability (40%) — quality of generated SQL on hard, messy schemas; benchmark evidence where public (BIRD, Spider 2.0); semantic grounding and self-correction.
  • Trust & governance (25%) — how the system prevents wrong-but-plausible answers: semantic layers, verified queries, permissions awareness, auditability.
  • Adoption signals (20%) — production usage, community momentum (stars, releases, case studies), ecosystem integrations.
  • Openness (15%) — open weights/source, self-hosting, extensibility, transparent docs.

The launch edition was scored by the founding editorial pass and is the baseline. From here, the desk re-scores monthly: every score change must cite evidence (release notes, benchmark submissions, engineering posts), and every edition links its diff. Vendors never pay for placement; this publication has no commercial relationship with anything it ranks.