AL
ENT-00000713 · Research System

AlpacaEval

AlpacaEval is a research system associated with Stanford University, classified in LXKeys.world as AI Research / Specialized System.

Level V PersistentActiveDocumented
Human record

Overview

AlpacaEval is documented as a research system, benchmark, dataset or scientific AI record associated with Stanford University. It is relevant for automatic evaluation framework for instruction-following models. The record helps situate evaluation, discovery, training evidence or scientific capability in the registry graph.

Timeline

  1. 2023Initial research publication or demonstration

    AlpacaEval entered the documented public record in 2023. This event is retained at the precision supported by the Entry’s reviewed source history.

Capabilities

Research evaluation or discoveryScientific or benchmark utilityStructured evidence generationModel or system analysis

Known limitations

Capabilities vary by release, deployment setting and evaluation method.Operational details may differ across hosted APIs, open releases or downstream integrations.
Technical and structured detail

Technical description

Structured LXKeys.world registry record for AlpacaEval. Entity type: Research System; classification: AI Research / Specialized System; creator/organization context: Stanford CRFM. Canonical source anchor: https://tatsu-lab.github.io/alpaca_eval/. The record tracks source authority, first public appearance, timeline, capabilities, limitations, registry status and graph relationships. Automatic refresh is limited to sources explicitly classified as OFFICIAL and enabled for updates; documentary and research references remain non-authoritative unless reviewed.

Controlled tags

Stanford UniversityResearch SystemResearchinstruction-following
Relationship graph

AlpacaEval

Open in full graph
AlpacaEval
Associated OrganizationOutgoing
Stanford University

Stanford University is the organization or ecosystem associated with AlpacaEval.

Creator or DeveloperOutgoing
Stanford CRFM

Stanford CRFM is identified as a creator, developer or originating actor for AlpacaEval.

Machine readable layer

Structured entry data for human tools, AI systems and machine clients.

{
    "@context": [
        "https://schema.org",
        {
            "lxw": "https://lxkeys.world/schema/"
        }
    ],
    "@type": "Thing",
    "identifier": "ENT-00000713",
    "name": "AlpacaEval",
    "alternateName": [],
    "additionalType": {
        "category": "Methods and Research",
        "type": "Research System",
        "subtype": "",
        "lxkeysEntity": false
    },
    "description": "AlpacaEval is a research system associated with Stanford University, classified in LXKeys.world as AI Research / Specialized System.",
    "creator": "Stanford CRFM",
    "url": "https://lxkeys.world/entry.php?id=ENT-00000713&lang=en",
    "sameAs": "https://tatsu-lab.github.io/alpaca_eval/",
    "image": "",
    "lxkeysWorld": {
        "worldId": "ENT-00000713",
        "kind": "Methods and Research",
        "type": "Research System",
        "subtype": "",
        "classification": "AI Research / Specialized System",
        "organization": "Stanford University",
        "originContext": "Benchmark",
        "firstPublicAppearance": "2023",
        "currentStatus": "Active",
        "documentationStatus": "Documented",
        "documentationIndex": {
            "total": 82,
            "documentation": 25,
            "evidence": 13,
            "structure": 25,
            "relationships": 19,
            "level": "Level V Persistent"
        },
        "lxCalendarium": {
            "start_date_utc": "2023-04-01",
            "created_utc": "2026-06-16T23:59:02+00:00",
            "created_dypclt": "D-0 Y-2 P-3 C-3 L-21 T-3",
            "updated_utc": "2026-06-16T23:59:02+00:00",
            "updated_dypclt": "D-0 Y-2 P-3 C-3 L-21 T-3"
        },
        "facts": [],
        "capabilities": [
            "Research evaluation or discovery",
            "Scientific or benchmark utility",
            "Structured evidence generation",
            "Model or system analysis"
        ],
        "limitations": [
            "Capabilities vary by release, deployment setting and evaluation method.",
            "Operational details may differ across hosted APIs, open releases or downstream integrations."
        ],
        "tags": [
            "Stanford University",
            "Research System",
            "Research",
            "instruction-following"
        ],
        "timeline": [
            {
                "date": "2023",
                "title": "Initial research publication or demonstration",
                "description": "AlpacaEval entered the documented public record in 2023. This event is retained at the precision supported by the Entry’s reviewed source history.",
                "source_url": "https://tatsu-lab.github.io/alpaca_eval/",
                "verification_status": "source_backed_official"
            }
        ],
        "relationships": [
            {
                "target": "Stanford University",
                "type": "Associated Organization",
                "description": "Stanford University is the organization or ecosystem associated with AlpacaEval.",
                "evidence_level": "documentary"
            },
            {
                "target": "Stanford CRFM",
                "type": "Creator or Developer",
                "description": "Stanford CRFM is identified as a creator, developer or originating actor for AlpacaEval.",
                "evidence_level": "documentary",
                "target_id": "ENT-00000729"
            }
        ],
        "sources": [
            {
                "label": "AlpacaEval official reference",
                "url": "https://tatsu-lab.github.io/alpaca_eval/",
                "source_type": "Official Documentation",
                "verification_status": "verified",
                "authority": "OFFICIAL",
                "role": "primary",
                "update_enabled": true,
                "authority_basis": "curated-corpus-refresh-2026-09-08"
            }
        ],
        "canonical": [],
        "imageMeta": []
    }
}
Proofs

Contribute to this record

Submit a source, correction or comment. Public changes remain moderated.

Submit proof or comment

Approved comments

No approved public comment yet.