HumanEval
ENT-00000707 · Research System

HumanEval

HumanEval is a research system associated with OpenAI, classified in LXKeys.world as AI Research / Specialized System.

Level IV ConnectedActiveDocumented
Human record

Overview

HumanEval is documented as a research system, benchmark, dataset or scientific AI record associated with OpenAI. It is relevant for benchmark for evaluating Python code generation. The record helps situate evaluation, discovery, training evidence or scientific capability in the registry graph.

Timeline

  1. 2021Initial research publication or demonstration

    HumanEval entered the documented public record in 2021. This event is retained at the precision supported by the Entry’s reviewed source history.

Capabilities

Research evaluation or discoveryScientific or benchmark utilityStructured evidence generationModel or system analysis

Known limitations

Capabilities vary by release, deployment setting and evaluation method.Operational details may differ across hosted APIs, open releases or downstream integrations.
Technical and structured detail

Technical description

Structured LXKeys.world registry record for HumanEval. Entity type: Research System; classification: AI Research / Specialized System; creator/organization context: OpenAI. Canonical source anchor: https://github.com/openai/human-eval. The record tracks source authority, first public appearance, timeline, capabilities, limitations, registry status and graph relationships. Automatic refresh is limited to sources explicitly classified as OFFICIAL and enabled for updates; documentary and research references remain non-authoritative unless reviewed.

Controlled tags

OpenAIResearch SystemResearchcode
Relationship graph

HumanEval

Open in full graph
HumanEval
Associated OrganizationOutgoing
OpenAI

OpenAI is the organization or ecosystem associated with HumanEval.

Machine readable layer

Structured entry data for human tools, AI systems and machine clients.

{
    "@context": [
        "https://schema.org",
        {
            "lxw": "https://lxkeys.world/schema/"
        }
    ],
    "@type": "Thing",
    "identifier": "ENT-00000707",
    "name": "HumanEval",
    "alternateName": [],
    "additionalType": {
        "category": "Methods and Research",
        "type": "Research System",
        "subtype": "",
        "lxkeysEntity": false
    },
    "description": "HumanEval is a research system associated with OpenAI, classified in LXKeys.world as AI Research / Specialized System.",
    "creator": "OpenAI",
    "url": "https://lxkeys.world/entry.php?id=ENT-00000707&lang=en",
    "sameAs": "https://github.com/openai/human-eval",
    "image": "https://lxkeys.world/uploads/entity-images/ENT-00000707.png",
    "lxkeysWorld": {
        "worldId": "ENT-00000707",
        "kind": "Methods and Research",
        "type": "Research System",
        "subtype": "",
        "classification": "AI Research / Specialized System",
        "organization": "OpenAI",
        "originContext": "Benchmark",
        "firstPublicAppearance": "2021",
        "currentStatus": "Active",
        "documentationStatus": "Documented",
        "documentationIndex": {
            "total": 74,
            "documentation": 25,
            "evidence": 13,
            "structure": 25,
            "relationships": 11,
            "level": "Level IV Connected"
        },
        "lxCalendarium": {
            "start_date_utc": "2023-04-01",
            "created_utc": "2026-06-16T23:59:02+00:00",
            "created_dypclt": "D-0 Y-2 P-3 C-3 L-21 T-3",
            "updated_utc": "2026-06-16T23:59:02+00:00",
            "updated_dypclt": "D-0 Y-2 P-3 C-3 L-21 T-3"
        },
        "facts": [],
        "capabilities": [
            "Research evaluation or discovery",
            "Scientific or benchmark utility",
            "Structured evidence generation",
            "Model or system analysis"
        ],
        "limitations": [
            "Capabilities vary by release, deployment setting and evaluation method.",
            "Operational details may differ across hosted APIs, open releases or downstream integrations."
        ],
        "tags": [
            "OpenAI",
            "Research System",
            "Research",
            "code"
        ],
        "timeline": [
            {
                "date": "2021",
                "title": "Initial research publication or demonstration",
                "description": "HumanEval entered the documented public record in 2021. This event is retained at the precision supported by the Entry’s reviewed source history.",
                "source_url": "https://github.com/openai/human-eval",
                "verification_status": "source_backed_curated_baseline"
            }
        ],
        "relationships": [
            {
                "target": "OpenAI",
                "type": "Associated Organization",
                "description": "OpenAI is the organization or ecosystem associated with HumanEval.",
                "evidence_level": "documentary",
                "target_id": "ENT-00000048"
            }
        ],
        "sources": [
            {
                "label": "HumanEval official reference",
                "url": "https://github.com/openai/human-eval",
                "source_type": "Official Documentation",
                "verification_status": "verified",
                "authority": "TRUSTED_PRIMARY",
                "role": "code_repository",
                "update_enabled": false,
                "authority_basis": "curated-corpus-refresh-2026-09-08"
            }
        ],
        "canonical": [],
        "imageMeta": {
            "path": "uploads/entity-images/ENT-00000707.png",
            "sha256": "cdcac4c0977933e1c8aa628669f5335db69050e9732a0fbdd26867ffcc8e22ae",
            "width": 512,
            "height": 512,
            "mime": "image/png",
            "provenance_status": "PROVENANCE_UNCONFIRMED",
            "review_status": "preserved_pending_official_verification",
            "legacy_provenance_status": "legacy_unverified",
            "source_type": "historical",
            "source_label": "LXKeys.world historical media corpus",
            "metadata_namespace": "urn:lxkeys:xmp:1.0",
            "metadata_embedded": true,
            "metadata_verified": true,
            "asset_id": "LXW-IMG-ENT-00000707-CDCAC4C09779",
            "processing_id": "LXP-20260908-739CF22AEA12",
            "processed_at_utc": "2026-09-08T18:00:00Z",
            "dypclt": "D-0 Y-2 P-4 C-4 L-33 T-6",
            "rights_holder": "",
            "rights_policy": "PROVENANCE_REVIEW_REQUIRED",
            "original_sha256": "cdcac4c0977933e1c8aa628669f5335db69050e9732a0fbdd26867ffcc8e22ae",
            "processed_sha256": "00cba05b72ba5acef78afb9384d9786e0a8f22be41b9b728825fd28ae131782e"
        }
    }
}
Proofs

Contribute to this record

Submit a source, correction or comment. Public changes remain moderated.

Submit proof or comment

Approved comments

No approved public comment yet.