BI
ENT-00001932 · Benchmark

BIRD-SQL

BIRD-SQL is a AI benchmark associated with Research community, classified in LXKeys.world as AI Benchmark / Evaluation.

Level V PersistentActiveDocumented
Human record

Overview

BIRD-SQL is a documented AI dataset or benchmark associated with Research community. The record identifies its role in evaluation, training, measurement or comparison of intelligent systems, with emphasis on the source context and the type of capability it helps assess.

Timeline

  1. 2023Initial benchmark release

    BIRD-SQL entered the documented public record in 2023. This event is retained at the precision supported by the Entry’s reviewed source history.

Capabilities

Data resourceEvaluation supportResearch referenceEvaluation protocol documentationModel comparison supportTask taxonomy mappingReproducible benchmark anchoringRelationship graph compatibility

Known limitations

Benchmark scores depend on the exact dataset version, prompt or evaluation protocol, scoring implementation and contamination controls.Leaderboard performance should not be treated as a complete measure of real-world capability or safety.Benchmark relevance can decline as models, data and evaluation practices evolve.
Technical and structured detail

Technical description

Structured LXKeys.world registry record for BIRD-SQL. Entity type: Benchmark; classification: AI Benchmark / Evaluation; creator/organization context: BIRD authors. Canonical source anchor: https://bird-bench.github.io/. The record tracks source authority, first public appearance, timeline, capabilities, limitations, registry status and graph relationships. Automatic refresh is limited to sources explicitly classified as OFFICIAL and enabled for updates; documentary and research references remain non-authoritative unless reviewed.

Controlled tags

DatasetBenchmarkEvaluationCode IntelligenceSoftware Engineering
Relationship graph

BIRD-SQL

Open in full graph
BIRD-SQL
Published byOutgoing
Research community

BIRD-SQL is associated with Research community through its documented source context.

Associated organizationOutgoing
BIRD benchmark contributors

BIRD benchmark contributors is the organization, project community or institutional context associated with BIRD SQL.

Domain contextOutgoing
Code and data reasoning evaluation

BIRD SQL belongs to the Code and data reasoning evaluation layer of the intelligent-entity registry.

Machine readable layer

Structured entry data for human tools, AI systems and machine clients.

{
    "@context": [
        "https://schema.org",
        {
            "lxw": "https://lxkeys.world/schema/"
        }
    ],
    "@type": "Thing",
    "identifier": "ENT-00001932",
    "name": "BIRD-SQL",
    "alternateName": [],
    "additionalType": {
        "category": "Data and Evaluation",
        "type": "Benchmark",
        "subtype": "",
        "lxkeysEntity": false
    },
    "description": "BIRD-SQL is a AI benchmark associated with Research community, classified in LXKeys.world as AI Benchmark / Evaluation.",
    "creator": "BIRD authors",
    "url": "https://lxkeys.world/entry.php?id=ENT-00001932&lang=en",
    "sameAs": "https://bird-bench.github.io/",
    "image": "",
    "lxkeysWorld": {
        "worldId": "ENT-00001932",
        "kind": "Data and Evaluation",
        "type": "Benchmark",
        "subtype": "",
        "classification": "AI Benchmark / Evaluation",
        "organization": "Research community",
        "originContext": "Public AI and technical record",
        "firstPublicAppearance": "2023",
        "currentStatus": "Active",
        "documentationStatus": "Documented",
        "documentationIndex": {
            "total": 88,
            "documentation": 25,
            "evidence": 13,
            "structure": 25,
            "relationships": 25,
            "level": "Level V Persistent"
        },
        "lxCalendarium": {
            "start_date_utc": "2023-04-01",
            "created_utc": "2026-06-16T23:59:29+00:00",
            "created_dypclt": "D-0 Y-2 P-3 C-3 L-21 T-3",
            "updated_utc": "2026-06-16T23:59:29+00:00",
            "updated_dypclt": "D-0 Y-2 P-3 C-3 L-21 T-3"
        },
        "facts": [],
        "capabilities": [
            "Data resource",
            "Evaluation support",
            "Research reference",
            "Evaluation protocol documentation",
            "Model comparison support",
            "Task taxonomy mapping",
            "Reproducible benchmark anchoring",
            "Relationship graph compatibility"
        ],
        "limitations": [
            "Benchmark scores depend on the exact dataset version, prompt or evaluation protocol, scoring implementation and contamination controls.",
            "Leaderboard performance should not be treated as a complete measure of real-world capability or safety.",
            "Benchmark relevance can decline as models, data and evaluation practices evolve."
        ],
        "tags": [
            "Dataset",
            "Benchmark",
            "Evaluation",
            "Code Intelligence",
            "Software Engineering"
        ],
        "timeline": [
            {
                "date": "2023",
                "title": "Initial benchmark release",
                "description": "BIRD-SQL entered the documented public record in 2023. This event is retained at the precision supported by the Entry’s reviewed source history.",
                "source_url": "https://bird-bench.github.io/",
                "verification_status": "source_backed_official"
            }
        ],
        "relationships": [
            {
                "target": "Research community",
                "type": "Published by",
                "description": "BIRD-SQL is associated with Research community through its documented source context.",
                "evidence_level": "documentary"
            },
            {
                "target": "BIRD benchmark contributors",
                "type": "Associated organization",
                "description": "BIRD benchmark contributors is the organization, project community or institutional context associated with BIRD SQL.",
                "evidence_level": "documentary"
            },
            {
                "target": "Code and data reasoning evaluation",
                "type": "Domain context",
                "description": "BIRD SQL belongs to the Code and data reasoning evaluation layer of the intelligent-entity registry.",
                "evidence_level": "documentary"
            }
        ],
        "sources": [
            {
                "label": "BIRD benchmark site",
                "url": "https://bird-bench.github.io/",
                "source_type": "Official Documentation",
                "verification_status": "verified",
                "authority": "OFFICIAL",
                "role": "primary",
                "update_enabled": true,
                "authority_basis": "curated-corpus-refresh-2026-09-08"
            }
        ],
        "canonical": [],
        "imageMeta": []
    }
}
Proofs

Contribute to this record

Submit a source, correction or comment. Public changes remain moderated.

Submit proof or comment

Approved comments

No approved public comment yet.