ENT-00001094 · Evaluation System

HotpotQA

HotpotQA is a multi-hop question answering benchmark associated with HotpotQA authors.

Level IV — ConnectedDocumentedStructured

Human readable record

Overview

HotpotQA is a documented multi-hop question answering benchmark used in artificial-intelligence research, evaluation or dataset construction. Its record captures the task context, public source, evaluation role and relationships to models, agents or research systems that rely on comparable measurements.

Timeline

2018HotpotQA public release or documentation
HotpotQA appears in public documentation as a multi-hop question answering benchmark associated with HotpotQA authors.

Capabilities

Evaluation referenceComparable measurementResearch reproducibilityModel documentation support

Known limitations

Benchmark interpretation depends on task design, data quality and contamination controls.Scores should not be treated as a complete measure of intelligence.

Technical and registry detail

Technical description

Structured reference record for HotpotQA. The technical layer captures source URL, creator, first-public year, evaluation or dataset role, measurable task family and relationships to model testing, retrieval, safety, coding, reasoning or multimodal assessment.

Controlled tags

BenchmarkEvaluationDocumentationEstablishedBatch 03 Candidate

Relationship graph

HotpotQA

Created or maintained byHotpotQA authors

HotpotQA is associated with HotpotQA authors.

Machine readable layer

Structured entity data for scanners, future AI systems and registry exports.

{
    "@context": "https://schema.org",
    "@type": "Thing",
    "identifier": "ENT-00001094",
    "name": "HotpotQA",
    "alternateName": [],
    "additionalType": "Evaluation System",
    "description": "HotpotQA is a multi-hop question answering benchmark associated with HotpotQA authors.",
    "creator": "HotpotQA authors",
    "url": "entity.php?id=ENT-00001094",
    "sameAs": "https://hotpotqa.github.io/",
    "lxkeysWorld": {
        "classification": "Multi-hop question answering benchmark",
        "organization": "HotpotQA authors",
        "originContext": "AI evaluation and dataset record",
        "firstPublicAppearance": "2018",
        "currentStatus": "Documented",
        "registryStatus": "Structured",
        "spatiumIndex": {
            "total": 74,
            "documentation": 25,
            "evidence": 13,
            "structure": 25,
            "relationships": 11,
            "level": "Level IV — Connected"
        },
        "lxCalendarium": {
            "start_date_utc": "2023-04-01",
            "created_utc": "2026-06-16T23:59:14+00:00",
            "created_dypclt": "D-0 Y-2 P-3 C-3 L-21 T-3",
            "updated_utc": "2026-06-16T23:59:14+00:00",
            "updated_dypclt": "D-0 Y-2 P-3 C-3 L-21 T-3",
            "reviewed_utc": "2026-06-16T23:59:14+00:00",
            "reviewed_dypclt": "D-0 Y-2 P-3 C-3 L-21 T-3"
        },
        "capabilities": [
            "Evaluation reference",
            "Comparable measurement",
            "Research reproducibility",
            "Model documentation support"
        ],
        "limitations": [
            "Benchmark interpretation depends on task design, data quality and contamination controls.",
            "Scores should not be treated as a complete measure of intelligence."
        ],
        "tags": [
            "Benchmark",
            "Evaluation",
            "Documentation",
            "Established",
            "Batch 03 Candidate"
        ],
        "timeline": [
            {
                "date": "2018",
                "title": "HotpotQA public release or documentation",
                "description": "HotpotQA appears in public documentation as a multi-hop question answering benchmark associated with HotpotQA authors."
            }
        ],
        "relationships": [
            {
                "target": "HotpotQA authors",
                "type": "Created or maintained by",
                "description": "HotpotQA is associated with HotpotQA authors.",
                "evidence_level": "documentary"
            }
        ],
        "sources": [
            {
                "label": "HotpotQA public reference",
                "url": "https://hotpotqa.github.io/",
                "source_type": "Primary or Research Source",
                "verification_status": "verified"
            }
        ]
    }
}

Proof and discussion layer

Contribute to this record

Submit a proof, correction or comment. Public display is moderated. Every submission remains preserved in the export archive.

Submit proof or comment

Approved comments

No approved public comment yet.