AA
ENT-00001931 · Benchmark

Abstraction and Reasoning Corpus

Abstraction and Reasoning Corpus is a AI benchmark associated with Research community, classified in LXKeys.world as AI Benchmark / Evaluation.

Niveau IV ConnectéActifDocumenté
Fiche publique

Vue d’ensemble

Abstraction and Reasoning Corpus is a documented AI dataset or benchmark associated with Research community. The record identifies its role in evaluation, training, measurement or comparison of intelligent systems, with emphasis on the source context and the type of capability it helps assess.

Chronologie

  1. 2019Initial benchmark release

    Abstraction and Reasoning Corpus entered the documented public record in 2019. This event is retained at the precision supported by the Entry’s reviewed source history.

Capacités

Data resourceEvaluation supportResearch reference

Limites connues

Benchmark scores depend on the exact dataset version, prompt or evaluation protocol, scoring implementation and contamination controls.Leaderboard performance should not be treated as a complete measure of real-world capability or safety.Benchmark relevance can decline as models, data and evaluation practices evolve.
Détail technique et structuré

Description technique

Structured LXKeys.world registry record for Abstraction and Reasoning Corpus. Entity type: Benchmark; classification: AI Benchmark / Evaluation; creator/organization context: François Chollet. Canonical source anchor: https://github.com/fchollet/ARC-AGI. The record tracks source authority, first public appearance, timeline, capabilities, limitations, registry status and graph relationships. Automatic refresh is limited to sources explicitly classified as OFFICIAL and enabled for updates; documentary and research references remain non-authoritative unless reviewed.

Tags contrôlés

DatasetBenchmarkEvaluation
Graphe relationnel

Abstraction and Reasoning Corpus

Ouvrir dans le graphe complet
Abstraction and Reasoning Corpus
Publié parSortante
Research community

Abstraction and Reasoning Corpus is associated with Research community through its documented source context.

Couche lisible par machine

Données structurées de l’entrée pour les outils humains, les systèmes IA et les clients machine.

{
    "@context": [
        "https://schema.org",
        {
            "lxw": "https://lxkeys.world/schema/"
        }
    ],
    "@type": "Thing",
    "identifier": "ENT-00001931",
    "name": "Abstraction and Reasoning Corpus",
    "alternateName": [],
    "additionalType": {
        "category": "Data and Evaluation",
        "type": "Benchmark",
        "subtype": "",
        "lxkeysEntity": false
    },
    "description": "Abstraction and Reasoning Corpus is a AI benchmark associated with Research community, classified in LXKeys.world as AI Benchmark / Evaluation.",
    "creator": "François Chollet",
    "url": "https://lxkeys.world/entry.php?id=ENT-00001931&lang=fr",
    "sameAs": "https://github.com/fchollet/ARC-AGI",
    "image": "",
    "lxkeysWorld": {
        "worldId": "ENT-00001931",
        "kind": "Data and Evaluation",
        "type": "Benchmark",
        "subtype": "",
        "classification": "AI Benchmark / Evaluation",
        "organization": "Research community",
        "originContext": "Public AI and technical record",
        "firstPublicAppearance": "2019",
        "currentStatus": "Active",
        "documentationStatus": "Documented",
        "documentationIndex": {
            "total": 74,
            "documentation": 25,
            "evidence": 13,
            "structure": 25,
            "relationships": 11,
            "level": "Level IV Connected"
        },
        "lxCalendarium": {
            "start_date_utc": "2023-04-01",
            "created_utc": "2026-06-16T23:59:29+00:00",
            "created_dypclt": "D-0 Y-2 P-3 C-3 L-21 T-3",
            "updated_utc": "2026-06-16T23:59:29+00:00",
            "updated_dypclt": "D-0 Y-2 P-3 C-3 L-21 T-3"
        },
        "facts": [],
        "capabilities": [
            "Data resource",
            "Evaluation support",
            "Research reference"
        ],
        "limitations": [
            "Benchmark scores depend on the exact dataset version, prompt or evaluation protocol, scoring implementation and contamination controls.",
            "Leaderboard performance should not be treated as a complete measure of real-world capability or safety.",
            "Benchmark relevance can decline as models, data and evaluation practices evolve."
        ],
        "tags": [
            "Dataset",
            "Benchmark",
            "Evaluation"
        ],
        "timeline": [
            {
                "date": "2019",
                "title": "Initial benchmark release",
                "description": "Abstraction and Reasoning Corpus entered the documented public record in 2019. This event is retained at the precision supported by the Entry’s reviewed source history.",
                "source_url": "https://github.com/fchollet/ARC-AGI",
                "verification_status": "source_backed_curated_baseline"
            }
        ],
        "relationships": [
            {
                "target": "Research community",
                "type": "Published by",
                "description": "Abstraction and Reasoning Corpus is associated with Research community through its documented source context.",
                "evidence_level": "documentary"
            }
        ],
        "sources": [
            {
                "label": "ARC repository",
                "url": "https://github.com/fchollet/ARC-AGI",
                "source_type": "Official Repository",
                "verification_status": "verified",
                "authority": "TRUSTED_PRIMARY",
                "role": "code_repository",
                "update_enabled": false,
                "authority_basis": "curated-corpus-refresh-2026-09-08"
            }
        ],
        "canonical": [],
        "imageMeta": []
    }
}
Preuves

Contribuer à cette entrée

Soumettez une source, une correction ou un commentaire. Les modifications publiques restent modérées.

Soumettre une preuve ou un commentaire

Commentaires approuvés

Aucun commentaire public approuvé pour le moment.