HO
ENT-00001094 · Benchmark

HotpotQA

HotpotQA is a AI benchmark associated with HotpotQA authors, classified in LXKeys.world as AI Benchmark / Evaluation.

Level IV ConnectedDocumentedDocumented
Human record

Overview

HotpotQA is a documented multi-hop question answering benchmark used in artificial-intelligence research, evaluation or dataset construction. Its record captures the task context, public source, evaluation role and relationships to models, agents or research systems that rely on comparable measurements.

Timeline

  1. 2018Initial benchmark release

    HotpotQA entered the documented public record in 2018. This event is retained at the precision supported by the Entry’s reviewed source history.

Capabilities

Evaluation referenceComparable measurementResearch reproducibilityModel documentation support

Known limitations

Benchmark interpretation depends on task design, data quality and contamination controls.Scores should not be treated as a complete measure of intelligence.
Technical and structured detail

Technical description

Structured reference record for HotpotQA. The technical layer captures source URL, creator, first-public year, evaluation or dataset role, measurable task family and relationships to model testing, retrieval, safety, coding, reasoning or multimodal assessment.

Controlled tags

BenchmarkEvaluationDocumentationEstablishedBatch 03 Candidate
Relationship graph

HotpotQA

Open in full graph
HotpotQA
Created or maintained byOutgoing
HotpotQA authors

HotpotQA is associated with HotpotQA authors.

Machine readable layer

Structured entry data for human tools, AI systems and machine clients.

{
    "@context": [
        "https://schema.org",
        {
            "lxw": "https://lxkeys.world/schema/"
        }
    ],
    "@type": "Thing",
    "identifier": "ENT-00001094",
    "name": "HotpotQA",
    "alternateName": [],
    "additionalType": {
        "category": "Data and Evaluation",
        "type": "Benchmark",
        "subtype": "",
        "lxkeysEntity": false
    },
    "description": "HotpotQA is a AI benchmark associated with HotpotQA authors, classified in LXKeys.world as AI Benchmark / Evaluation.",
    "creator": "HotpotQA authors",
    "url": "https://lxkeys.world/entry.php?id=ENT-00001094&lang=en",
    "sameAs": "https://hotpotqa.github.io/",
    "image": "",
    "lxkeysWorld": {
        "worldId": "ENT-00001094",
        "kind": "Data and Evaluation",
        "type": "Benchmark",
        "subtype": "",
        "classification": "AI Benchmark / Evaluation",
        "organization": "HotpotQA authors",
        "originContext": "AI evaluation and dataset record",
        "firstPublicAppearance": "2018",
        "currentStatus": "Documented",
        "documentationStatus": "Documented",
        "documentationIndex": {
            "total": 74,
            "documentation": 25,
            "evidence": 13,
            "structure": 25,
            "relationships": 11,
            "level": "Level IV Connected"
        },
        "lxCalendarium": {
            "start_date_utc": "2023-04-01",
            "created_utc": "2026-06-16T23:59:14+00:00",
            "created_dypclt": "D-0 Y-2 P-3 C-3 L-21 T-3",
            "updated_utc": "2026-06-16T23:59:14+00:00",
            "updated_dypclt": "D-0 Y-2 P-3 C-3 L-21 T-3"
        },
        "facts": [],
        "capabilities": [
            "Evaluation reference",
            "Comparable measurement",
            "Research reproducibility",
            "Model documentation support"
        ],
        "limitations": [
            "Benchmark interpretation depends on task design, data quality and contamination controls.",
            "Scores should not be treated as a complete measure of intelligence."
        ],
        "tags": [
            "Benchmark",
            "Evaluation",
            "Documentation",
            "Established",
            "Batch 03 Candidate"
        ],
        "timeline": [
            {
                "date": "2018",
                "title": "Initial benchmark release",
                "description": "HotpotQA entered the documented public record in 2018. This event is retained at the precision supported by the Entry’s reviewed source history.",
                "source_url": "https://hotpotqa.github.io/",
                "verification_status": "source_backed_official"
            }
        ],
        "relationships": [
            {
                "target": "HotpotQA authors",
                "type": "Created or maintained by",
                "description": "HotpotQA is associated with HotpotQA authors.",
                "evidence_level": "documentary"
            }
        ],
        "sources": [
            {
                "label": "HotpotQA public reference",
                "url": "https://hotpotqa.github.io/",
                "source_type": "Primary or Research Source",
                "verification_status": "verified",
                "authority": "OFFICIAL",
                "role": "primary",
                "update_enabled": true,
                "authority_basis": "curated-corpus-refresh-2026-09-08"
            }
        ],
        "canonical": [],
        "imageMeta": []
    }
}
Proofs

Contribute to this record

Submit a source, correction or comment. Public changes remain moderated.

Submit proof or comment

Approved comments

No approved public comment yet.