live wire
▸Gemma-4-E2B text-to-SQL adapter ships weights but no SQL evaluation, dataset disclosure or task-specific exampleHugging Face model card▸Qwen2.5-3B GRPO adapter posts 62.67% Spider dev execution accuracy, 1.8 points above base; base leads execution successHugging Face model card▸NextGen Healthcare opens N.I.A. analytics agent to early adopters; all Insights clients get it in early NovemberNextGen Healthcare▸Overseas Tax Agent posts a 200-case synthetic eval; tax math is deterministic, but SQL and RAG tools remain stubsGitHub repository▸Databricks says Genie rose from 32% to 90%+ on an internal benchmark; task count and artifacts are undisclosedDatabricks▸Tableau says agent traces and human corrections continually reshape its runtime knowledge graphTableau▸ThoughtSpot urges separate read/write permissions and explicit approval for production-impacting agent actionsThoughtSpot▸SchemaGate v1.11.1 drops sentence-like notes after complete SQL; 28,785-reply replay changed one trailing commentSchemaGate▸Teradata adds agent-aware ABAC, identity reduction and immutable backups for enterprise AI dataTeradata▸Huel says it moved staff to Spotter-first analytics after a direct Snowflake-to-Claude trial lacked explainabilityThoughtSpot customer essay▸KG mediation reaches 89.47%/90.29% F1 on 158 enterprise prompts; only 30 receive preliminary end-to-end trialsECIS 2026 paper▸MotherDuck says hiding query_rw is insufficient for MCP read-only mode; other write/delete tools need separate reviewMotherDuck▸Oracle AIDP adds progressively disclosed Agent Skills with optional declared Python entrypoints for high-code agentsOracle▸ThoughtSpot says Spotter 3 may retry forecasts with a different model after evaluating confidence intervalsThoughtSpot▸Gemma-4-E2B text-to-SQL adapter ships weights but no SQL evaluation, dataset disclosure or task-specific exampleHugging Face model card▸Qwen2.5-3B GRPO adapter posts 62.67% Spider dev execution accuracy, 1.8 points above base; base leads execution successHugging Face model card▸NextGen Healthcare opens N.I.A. analytics agent to early adopters; all Insights clients get it in early NovemberNextGen Healthcare▸Overseas Tax Agent posts a 200-case synthetic eval; tax math is deterministic, but SQL and RAG tools remain stubsGitHub repository▸Databricks says Genie rose from 32% to 90%+ on an internal benchmark; task count and artifacts are undisclosedDatabricks▸Tableau says agent traces and human corrections continually reshape its runtime knowledge graphTableau▸ThoughtSpot urges separate read/write permissions and explicit approval for production-impacting agent actionsThoughtSpot▸SchemaGate v1.11.1 drops sentence-like notes after complete SQL; 28,785-reply replay changed one trailing commentSchemaGate▸Teradata adds agent-aware ABAC, identity reduction and immutable backups for enterprise AI dataTeradata▸Huel says it moved staff to Spotter-first analytics after a direct Snowflake-to-Claude trial lacked explainabilityThoughtSpot customer essay▸KG mediation reaches 89.47%/90.29% F1 on 158 enterprise prompts; only 30 receive preliminary end-to-end trialsECIS 2026 paper▸MotherDuck says hiding query_rw is insufficient for MCP read-only mode; other write/delete tools need separate reviewMotherDuck▸Oracle AIDP adds progressively disclosed Agent Skills with optional declared Python entrypoints for high-code agentsOracle▸ThoughtSpot says Spotter 3 may retry forecasts with a different model after evaluating confidence intervalsThoughtSpot
nl2sql.ai
analysisModel release

A new Gemma text-to-SQL adapter has weights—but not enough evidence to evaluate it

The repository is runnable, yet it omits the dataset, SQL benchmark, task-specific example and a usable license identifier. That distinction matters before anyone treats an upload as a release candidate.

By The News Desk· Oct 25, 2026the quick take — two AI hosts go live when you do

A newly uploaded adapter named gemma-text-to-sql is easy to discover and possible to download, but its public evidence stops well before practitioners can judge whether it works. The Hugging Face repository identifies the base as Google’s Gemma-4-E2B, says the adapter was trained with supervised fine-tuning through TRL, and includes model weights. It does not report a text-to-SQL benchmark, identify the training dataset, or provide a SQL-specific input and output example.[^1][^2]

That is not a cosmetic documentation problem. For a text-to-SQL model, the missing pieces prevent four basic checks: whether evaluation queries were held out from training, whether generated SQL executes, whether it returns the right result, and which SQL dialects or schema shapes the model has seen. A model name and a downloadable artifact establish availability; they do not establish task quality.

What the repository actually contains

The repository tree includes a roughly 10.7 MB adapter weights file, adapter configuration, tokenizer files, training arguments and one TensorBoard event file. It does not include an evaluation-results file, benchmark predictions, a test split or a separate evaluation script.[^2] The platform metadata showed zero downloads and zero likes when checked, so there is also no adoption signal to substitute for direct evaluation evidence.[^3]

The model card’s quick-start snippet is another useful warning sign: its sample prompt asks a generic time-machine preference question rather than presenting a database schema and a natural-language query.[^1] The card also writes licence: license instead of declaring a recognizable license identifier, while the platform’s model tags do not list a license.[^1][^3] Teams should therefore resolve usage rights before redistributing or embedding the adapter.

A practical acceptance gate

Before testing this adapter against production schemas, require a minimal evidence bundle:

  1. Name the training dataset and its split strategy.
  2. Publish executable predictions on a recognized benchmark or a disclosed domain test set.
  3. Report both execution success and result correctness; one can improve while the other degrades.
  4. Show the prompt format with schema context and at least one SQL output.
  5. Declare the license explicitly.

The adapter may ultimately prove useful; the current repository simply does not provide the evidence needed to make that judgment. The right classification today is runnable experiment, not evaluated text-to-SQL release.

[^1]: Hugging Face model card [^2]: Hugging Face repository tree API [^3]: Hugging Face model metadata API

sources

Filed by The News Desk. Corrections: desk@nl2sql.ai · Our standards →

comments · 0

    Comments are moderated before they appear. Your email is used once to confirm it is you — never shown, never sold. Corrections and questions get an answer from the desk when we have one.