M
ENT-00000714 · Research System

MT-Bench

MT-Bench is a documented research system associated with LMSYS.

Level IV — ConnectedActiveDocumented
Human readable record

Overview

MT-Bench is documented as a research system, benchmark, dataset or scientific AI record associated with LMSYS. It is relevant for benchmark for multi-turn conversational evaluation. The record helps situate evaluation, discovery, training evidence or scientific capability in the registry graph.

Timeline

  1. 2023MT-Bench public reference

    MT-Bench is publicly documented in relation to LMSYS.

Capabilities

Research evaluation or discoveryScientific or benchmark utilityStructured evidence generationModel or system analysis

Known limitations

Capabilities vary by release, deployment setting and evaluation method.Operational details may differ across hosted APIs, open releases or downstream integrations.
Technical and registry detail

Technical description

Structured record for MT-Bench. The technical layer identifies entity type Research System, organization LMSYS, source anchor https://github.com/lm-sys/FastChat/tree/main/fastchat/llm_judge, capability fields, limitation fields, timeline event, source records, tags (LMSYS, Research System, Research) and graph relationships for machine-readable registry integration.

Controlled tags

LMSYSResearch SystemResearchmulti-turn
Relationship graph
MT-Bench
Associated OrganizationLMSYS

LMSYS is the organization or ecosystem associated with MT-Bench.

Machine readable layer

Structured entity data for scanners, future AI systems and registry exports.

{
    "@context": "https://schema.org",
    "@type": "Thing",
    "identifier": "ENT-00000714",
    "name": "MT-Bench",
    "alternateName": [],
    "additionalType": "Research System",
    "description": "MT-Bench is a documented research system associated with LMSYS.",
    "creator": "LMSYS",
    "url": "entity.php?id=ENT-00000714",
    "sameAs": "https://github.com/lm-sys/FastChat/tree/main/fastchat/llm_judge",
    "lxkeysWorld": {
        "classification": "multi-turn chat benchmark",
        "organization": "LMSYS",
        "originContext": "Benchmark",
        "firstPublicAppearance": "2023",
        "currentStatus": "Active",
        "registryStatus": "Documented",
        "spatiumIndex": {
            "total": 74,
            "documentation": 25,
            "evidence": 13,
            "structure": 25,
            "relationships": 11,
            "level": "Level IV — Connected"
        },
        "lxCalendarium": {
            "start_date_utc": "2023-04-01",
            "created_utc": "2026-06-16T23:59:02+00:00",
            "created_dypclt": "D-0 Y-2 P-3 C-3 L-21 T-3",
            "updated_utc": "2026-06-16T23:59:02+00:00",
            "updated_dypclt": "D-0 Y-2 P-3 C-3 L-21 T-3",
            "reviewed_utc": "2026-06-16T23:59:02+00:00",
            "reviewed_dypclt": "D-0 Y-2 P-3 C-3 L-21 T-3"
        },
        "capabilities": [
            "Research evaluation or discovery",
            "Scientific or benchmark utility",
            "Structured evidence generation",
            "Model or system analysis"
        ],
        "limitations": [
            "Capabilities vary by release, deployment setting and evaluation method.",
            "Operational details may differ across hosted APIs, open releases or downstream integrations."
        ],
        "tags": [
            "LMSYS",
            "Research System",
            "Research",
            "multi-turn"
        ],
        "timeline": [
            {
                "date": "2023",
                "title": "MT-Bench public reference",
                "description": "MT-Bench is publicly documented in relation to LMSYS."
            }
        ],
        "relationships": [
            {
                "target": "LMSYS",
                "type": "Associated Organization",
                "description": "LMSYS is the organization or ecosystem associated with MT-Bench.",
                "evidence_level": "documentary"
            }
        ],
        "sources": [
            {
                "label": "MT-Bench official reference",
                "url": "https://github.com/lm-sys/FastChat/tree/main/fastchat/llm_judge",
                "source_type": "Official Documentation",
                "verification_status": "verified"
            }
        ]
    }
}
Proof and discussion layer

Contribute to this record

Submit a proof, correction or comment. Public display is moderated. Every submission remains preserved in the export archive.

Submit proof or comment

Approved comments

No approved public comment yet.