ENT-00000706 · Research System

HELM

HELM is a documented research system associated with Stanford University.

Level V — PersistentActiveDocumented

Human readable record

Overview

HELM is documented as a research system, benchmark, dataset or scientific AI record associated with Stanford University. It is relevant for Holistic Evaluation of Language Models benchmark framework. The record helps situate evaluation, discovery, training evidence or scientific capability in the registry graph.

Timeline

2022HELM public reference
HELM is publicly documented in relation to Stanford University.

Capabilities

Research evaluation or discoveryScientific or benchmark utilityStructured evidence generationModel or system analysis

Known limitations

Capabilities vary by release, deployment setting and evaluation method.Operational details may differ across hosted APIs, open releases or downstream integrations.

Technical and registry detail

Technical description

Structured record for HELM. The technical layer identifies entity type Research System, organization Stanford University, source anchor https://crfm.stanford.edu/helm/, capability fields, limitation fields, timeline event, source records, tags (Stanford University, Research System, Research) and graph relationships for machine-readable registry integration.

Controlled tags

Stanford UniversityResearch SystemResearchAI

Relationship graph

HELM

Associated OrganizationStanford University

Stanford University is the organization or ecosystem associated with HELM.

Creator or DeveloperStanford CRFM

Stanford CRFM is identified as a creator, developer or originating actor for HELM.

Machine readable layer

Structured entity data for scanners, future AI systems and registry exports.

{
    "@context": "https://schema.org",
    "@type": "Thing",
    "identifier": "ENT-00000706",
    "name": "HELM",
    "alternateName": [],
    "additionalType": "Research System",
    "description": "HELM is a documented research system associated with Stanford University.",
    "creator": "Stanford CRFM",
    "url": "entity.php?id=ENT-00000706",
    "sameAs": "https://crfm.stanford.edu/helm/",
    "lxkeysWorld": {
        "classification": "AI evaluation framework",
        "organization": "Stanford University",
        "originContext": "Benchmark",
        "firstPublicAppearance": "2022",
        "currentStatus": "Active",
        "registryStatus": "Documented",
        "spatiumIndex": {
            "total": 82,
            "documentation": 25,
            "evidence": 13,
            "structure": 25,
            "relationships": 19,
            "level": "Level V — Persistent"
        },
        "lxCalendarium": {
            "start_date_utc": "2023-04-01",
            "created_utc": "2026-06-16T23:59:02+00:00",
            "created_dypclt": "D-0 Y-2 P-3 C-3 L-21 T-3",
            "updated_utc": "2026-06-16T23:59:02+00:00",
            "updated_dypclt": "D-0 Y-2 P-3 C-3 L-21 T-3",
            "reviewed_utc": "2026-06-16T23:59:02+00:00",
            "reviewed_dypclt": "D-0 Y-2 P-3 C-3 L-21 T-3"
        },
        "capabilities": [
            "Research evaluation or discovery",
            "Scientific or benchmark utility",
            "Structured evidence generation",
            "Model or system analysis"
        ],
        "limitations": [
            "Capabilities vary by release, deployment setting and evaluation method.",
            "Operational details may differ across hosted APIs, open releases or downstream integrations."
        ],
        "tags": [
            "Stanford University",
            "Research System",
            "Research",
            "AI"
        ],
        "timeline": [
            {
                "date": "2022",
                "title": "HELM public reference",
                "description": "HELM is publicly documented in relation to Stanford University."
            }
        ],
        "relationships": [
            {
                "target": "Stanford University",
                "type": "Associated Organization",
                "description": "Stanford University is the organization or ecosystem associated with HELM.",
                "evidence_level": "documentary"
            },
            {
                "target": "Stanford CRFM",
                "type": "Creator or Developer",
                "description": "Stanford CRFM is identified as a creator, developer or originating actor for HELM.",
                "evidence_level": "documentary"
            }
        ],
        "sources": [
            {
                "label": "HELM official reference",
                "url": "https://crfm.stanford.edu/helm/",
                "source_type": "Official Documentation",
                "verification_status": "verified"
            }
        ]
    }
}

Proof and discussion layer

Contribute to this record

Submit a proof, correction or comment. Public display is moderated. Every submission remains preserved in the export archive.

Submit proof or comment

Approved comments

No approved public comment yet.