Q
ENT-00002826 · Benchmark

QuixBugs

QuixBugs is a code / data reasoning benchmark associated with QuixBugs contributors.

Level V — PersistentActiveDocumented
Human readable record

Overview

QuixBugs is a documented benchmark or dataset used to evaluate code intelligence, program synthesis, debugging, semantic parsing or data reasoning. It is recorded as program repair benchmark.

Timeline

  1. 2017Public release or documentation

    QuixBugs appears in public documentation, project records, benchmark descriptions or research references associated with QuixBugs contributors.

Capabilities

Evaluation protocol documentationModel comparison supportTask taxonomy mappingReproducible benchmark anchoringRelationship graph compatibility

Known limitations

Benchmark results can become stale as models improve and evaluation protocols evolve.A benchmark measures a defined task scope rather than complete intelligence.
Technical and registry detail

Technical description

Structured record for QuixBugs. The technical layer identifies the entity type, classification, creator or organization, official source anchor, capabilities, limitations, timeline entries and graph relationships without adding internal import events to the public history.

Controlled tags

BenchmarkCode IntelligenceSoftware EngineeringEvaluation
Relationship graph
QuixBugs
Associated organizationQuixBugs contributors

QuixBugs contributors is the organization, project community or institutional context associated with QuixBugs.

Domain contextCode and data reasoning evaluation

QuixBugs belongs to the Code and data reasoning evaluation layer of the intelligent-entity registry.

Machine readable layer

Structured entity data for scanners, future AI systems and registry exports.

{
    "@context": "https://schema.org",
    "@type": "Thing",
    "identifier": "ENT-00002826",
    "name": "QuixBugs",
    "alternateName": [],
    "additionalType": "Benchmark",
    "description": "QuixBugs is a code / data reasoning benchmark associated with QuixBugs contributors.",
    "creator": "QuixBugs contributors",
    "url": "entity.php?id=ENT-00002826",
    "sameAs": "https://github.com/jkoppel/QuixBugs",
    "lxkeysWorld": {
        "classification": "Code / Data Reasoning Benchmark",
        "organization": "QuixBugs contributors",
        "originContext": "Code and data reasoning evaluation",
        "firstPublicAppearance": "2017",
        "currentStatus": "Active",
        "registryStatus": "Documented",
        "spatiumIndex": {
            "total": 82,
            "documentation": 25,
            "evidence": 13,
            "structure": 25,
            "relationships": 19,
            "level": "Level V — Persistent"
        },
        "lxCalendarium": {
            "start_date_utc": "2023-04-01",
            "created_utc": "2026-06-17T01:48:33+00:00",
            "created_dypclt": "D-0 Y-2 P-3 C-3 L-22 T-4",
            "updated_utc": "2026-06-17T01:48:33+00:00",
            "updated_dypclt": "D-0 Y-2 P-3 C-3 L-22 T-4",
            "reviewed_utc": "2026-06-17T01:48:33+00:00",
            "reviewed_dypclt": "D-0 Y-2 P-3 C-3 L-22 T-4"
        },
        "capabilities": [
            "Evaluation protocol documentation",
            "Model comparison support",
            "Task taxonomy mapping",
            "Reproducible benchmark anchoring",
            "Relationship graph compatibility"
        ],
        "limitations": [
            "Benchmark results can become stale as models improve and evaluation protocols evolve.",
            "A benchmark measures a defined task scope rather than complete intelligence."
        ],
        "tags": [
            "Benchmark",
            "Code Intelligence",
            "Software Engineering",
            "Evaluation"
        ],
        "timeline": [
            {
                "date": "2017",
                "title": "Public release or documentation",
                "description": "QuixBugs appears in public documentation, project records, benchmark descriptions or research references associated with QuixBugs contributors."
            }
        ],
        "relationships": [
            {
                "target": "QuixBugs contributors",
                "type": "Associated organization",
                "description": "QuixBugs contributors is the organization, project community or institutional context associated with QuixBugs.",
                "evidence_level": "documentary"
            },
            {
                "target": "Code and data reasoning evaluation",
                "type": "Domain context",
                "description": "QuixBugs belongs to the Code and data reasoning evaluation layer of the intelligent-entity registry.",
                "evidence_level": "documentary"
            }
        ],
        "sources": [
            {
                "label": "Official or reference source",
                "url": "https://github.com/jkoppel/QuixBugs",
                "source_type": "Research Source",
                "verification_status": "verified"
            }
        ]
    }
}
Proof and discussion layer

Contribute to this record

Submit a proof, correction or comment. Public display is moderated. Every submission remains preserved in the export archive.

Submit proof or comment

Approved comments

No approved public comment yet.