HE
ENT-00001103 · Benchmark

HellaSwag

HellaSwag is a AI benchmark associated with Allen Institute for AI, classified in LXKeys.world as AI Benchmark / Evaluation.

Level IV ConnectedDocumentedDocumented
Human record

Overview

HellaSwag is a documented commonsense inference benchmark used in artificial-intelligence research, evaluation or dataset construction. Its record captures the task context, public source, evaluation role and relationships to models, agents or research systems that rely on comparable measurements.

Timeline

  1. 2019Initial benchmark release

    HellaSwag entered the documented public record in 2019. This event is retained at the precision supported by the Entry’s reviewed source history.

Capabilities

Evaluation referenceComparable measurementResearch reproducibilityModel documentation support

Known limitations

Benchmark interpretation depends on task design, data quality and contamination controls.Scores should not be treated as a complete measure of intelligence.
Technical and structured detail

Technical description

Structured reference record for HellaSwag. The technical layer captures source URL, creator, first-public year, evaluation or dataset role, measurable task family and relationships to model testing, retrieval, safety, coding, reasoning or multimodal assessment.

Controlled tags

BenchmarkEvaluationDocumentationEstablishedBatch 03 Candidate
Relationship graph

HellaSwag

Open in full graph
HellaSwag
Created or maintained byOutgoing
Allen Institute for AI

HellaSwag is associated with Allen Institute for AI.

Machine readable layer

Structured entry data for human tools, AI systems and machine clients.

{
    "@context": [
        "https://schema.org",
        {
            "lxw": "https://lxkeys.world/schema/"
        }
    ],
    "@type": "Thing",
    "identifier": "ENT-00001103",
    "name": "HellaSwag",
    "alternateName": [],
    "additionalType": {
        "category": "Data and Evaluation",
        "type": "Benchmark",
        "subtype": "",
        "lxkeysEntity": false
    },
    "description": "HellaSwag is a AI benchmark associated with Allen Institute for AI, classified in LXKeys.world as AI Benchmark / Evaluation.",
    "creator": "Allen Institute for AI",
    "url": "https://lxkeys.world/entry.php?id=ENT-00001103&lang=en",
    "sameAs": "https://rowanzellers.com/hellaswag/",
    "image": "",
    "lxkeysWorld": {
        "worldId": "ENT-00001103",
        "kind": "Data and Evaluation",
        "type": "Benchmark",
        "subtype": "",
        "classification": "AI Benchmark / Evaluation",
        "organization": "Allen Institute for AI",
        "originContext": "AI evaluation and dataset record",
        "firstPublicAppearance": "2019",
        "currentStatus": "Documented",
        "documentationStatus": "Documented",
        "documentationIndex": {
            "total": 74,
            "documentation": 25,
            "evidence": 13,
            "structure": 25,
            "relationships": 11,
            "level": "Level IV Connected"
        },
        "lxCalendarium": {
            "start_date_utc": "2023-04-01",
            "created_utc": "2026-06-16T23:59:14+00:00",
            "created_dypclt": "D-0 Y-2 P-3 C-3 L-21 T-3",
            "updated_utc": "2026-06-16T23:59:14+00:00",
            "updated_dypclt": "D-0 Y-2 P-3 C-3 L-21 T-3"
        },
        "facts": [],
        "capabilities": [
            "Evaluation reference",
            "Comparable measurement",
            "Research reproducibility",
            "Model documentation support"
        ],
        "limitations": [
            "Benchmark interpretation depends on task design, data quality and contamination controls.",
            "Scores should not be treated as a complete measure of intelligence."
        ],
        "tags": [
            "Benchmark",
            "Evaluation",
            "Documentation",
            "Established",
            "Batch 03 Candidate"
        ],
        "timeline": [
            {
                "date": "2019",
                "title": "Initial benchmark release",
                "description": "HellaSwag entered the documented public record in 2019. This event is retained at the precision supported by the Entry’s reviewed source history.",
                "source_url": "https://rowanzellers.com/hellaswag/",
                "verification_status": "source_backed_official"
            }
        ],
        "relationships": [
            {
                "target": "Allen Institute for AI",
                "type": "Created or maintained by",
                "description": "HellaSwag is associated with Allen Institute for AI.",
                "evidence_level": "documentary",
                "target_id": "ENT-00000728"
            }
        ],
        "sources": [
            {
                "label": "HellaSwag public reference",
                "url": "https://rowanzellers.com/hellaswag/",
                "source_type": "Primary or Research Source",
                "verification_status": "verified",
                "authority": "OFFICIAL",
                "role": "primary",
                "update_enabled": true,
                "authority_basis": "curated-corpus-refresh-2026-09-08"
            }
        ],
        "canonical": [],
        "imageMeta": []
    }
}
Proofs

Contribute to this record

Submit a source, correction or comment. Public changes remain moderated.

Submit proof or comment

Approved comments

No approved public comment yet.