ENT-00000707 · Research System

HumanEval

HumanEval is a documented research system associated with OpenAI.

Level IV — ConnectedActiveDocumented

Human readable record

Overview

HumanEval is documented as a research system, benchmark, dataset or scientific AI record associated with OpenAI. It is relevant for benchmark for evaluating Python code generation. The record helps situate evaluation, discovery, training evidence or scientific capability in the registry graph.

Timeline

2021HumanEval public reference
HumanEval is publicly documented in relation to OpenAI.

Capabilities

Research evaluation or discoveryScientific or benchmark utilityStructured evidence generationModel or system analysis

Known limitations

Capabilities vary by release, deployment setting and evaluation method.Operational details may differ across hosted APIs, open releases or downstream integrations.

Technical and registry detail

Technical description

Structured record for HumanEval. The technical layer identifies entity type Research System, organization OpenAI, source anchor https://github.com/openai/human-eval, capability fields, limitation fields, timeline event, source records, tags (OpenAI, Research System, Research) and graph relationships for machine-readable registry integration.

Controlled tags

OpenAIResearch SystemResearchcode

Relationship graph

HumanEval

Associated OrganizationOpenAI

OpenAI is the organization or ecosystem associated with HumanEval.

Machine readable layer

Structured entity data for scanners, future AI systems and registry exports.

{
    "@context": "https://schema.org",
    "@type": "Thing",
    "identifier": "ENT-00000707",
    "name": "HumanEval",
    "alternateName": [],
    "additionalType": "Research System",
    "description": "HumanEval is a documented research system associated with OpenAI.",
    "creator": "OpenAI",
    "url": "entity.php?id=ENT-00000707",
    "sameAs": "https://github.com/openai/human-eval",
    "lxkeysWorld": {
        "classification": "code generation benchmark",
        "organization": "OpenAI",
        "originContext": "Benchmark",
        "firstPublicAppearance": "2021",
        "currentStatus": "Active",
        "registryStatus": "Documented",
        "spatiumIndex": {
            "total": 74,
            "documentation": 25,
            "evidence": 13,
            "structure": 25,
            "relationships": 11,
            "level": "Level IV — Connected"
        },
        "lxCalendarium": {
            "start_date_utc": "2023-04-01",
            "created_utc": "2026-06-16T23:59:02+00:00",
            "created_dypclt": "D-0 Y-2 P-3 C-3 L-21 T-3",
            "updated_utc": "2026-06-16T23:59:02+00:00",
            "updated_dypclt": "D-0 Y-2 P-3 C-3 L-21 T-3",
            "reviewed_utc": "2026-06-16T23:59:02+00:00",
            "reviewed_dypclt": "D-0 Y-2 P-3 C-3 L-21 T-3"
        },
        "capabilities": [
            "Research evaluation or discovery",
            "Scientific or benchmark utility",
            "Structured evidence generation",
            "Model or system analysis"
        ],
        "limitations": [
            "Capabilities vary by release, deployment setting and evaluation method.",
            "Operational details may differ across hosted APIs, open releases or downstream integrations."
        ],
        "tags": [
            "OpenAI",
            "Research System",
            "Research",
            "code"
        ],
        "timeline": [
            {
                "date": "2021",
                "title": "HumanEval public reference",
                "description": "HumanEval is publicly documented in relation to OpenAI."
            }
        ],
        "relationships": [
            {
                "target": "OpenAI",
                "type": "Associated Organization",
                "description": "OpenAI is the organization or ecosystem associated with HumanEval.",
                "evidence_level": "documentary"
            }
        ],
        "sources": [
            {
                "label": "HumanEval official reference",
                "url": "https://github.com/openai/human-eval",
                "source_type": "Official Documentation",
                "verification_status": "verified"
            }
        ]
    }
}

Proof and discussion layer

Contribute to this record

Submit a proof, correction or comment. Public display is moderated. Every submission remains preserved in the export archive.

Submit proof or comment

Approved comments

No approved public comment yet.