CC
ENT-00001137 · Jeu de données

Common Crawl

Common Crawl is a dataset associated with Common Crawl Foundation, classified in LXKeys.world as Language / Training Dataset.

Niveau IV ConnectéDocumentéDocumenté
Fiche publique

Vue d’ensemble

Common Crawl is a documented web crawl corpus used in artificial-intelligence research, evaluation or dataset construction. Its record captures the task context, public source, evaluation role and relationships to models, agents or research systems that rely on comparable measurements.

Chronologie

  1. 2008Initial dataset release

    Common Crawl entered the documented public record in 2008. This event is retained at the precision supported by the Entry’s reviewed source history.

Capacités

Evaluation referenceComparable measurementResearch reproducibilityModel documentation support

Limites connues

Benchmark interpretation depends on task design, data quality and contamination controls.Scores should not be treated as a complete measure of intelligence.
Détail technique et structuré

Description technique

Structured reference record for Common Crawl. The technical layer captures source URL, creator, first-public year, evaluation or dataset role, measurable task family and relationships to model testing, retrieval, safety, coding, reasoning or multimodal assessment.

Tags contrôlés

DatasetEvaluationDocumentationEstablishedBatch 03 Candidate
Graphe relationnel

Common Crawl

Ouvrir dans le graphe complet
Common Crawl
Créé ou maintenu parSortante
Common Crawl Foundation

Common Crawl is associated with Common Crawl Foundation.

Couche lisible par machine

Données structurées de l’entrée pour les outils humains, les systèmes IA et les clients machine.

{
    "@context": [
        "https://schema.org",
        {
            "lxw": "https://lxkeys.world/schema/"
        }
    ],
    "@type": "Thing",
    "identifier": "ENT-00001137",
    "name": "Common Crawl",
    "alternateName": [],
    "additionalType": {
        "category": "Data and Evaluation",
        "type": "Dataset",
        "subtype": "",
        "lxkeysEntity": false
    },
    "description": "Common Crawl is a dataset associated with Common Crawl Foundation, classified in LXKeys.world as Language / Training Dataset.",
    "creator": "Common Crawl Foundation",
    "url": "https://lxkeys.world/entry.php?id=ENT-00001137&lang=fr",
    "sameAs": "https://commoncrawl.org/",
    "image": "",
    "lxkeysWorld": {
        "worldId": "ENT-00001137",
        "kind": "Data and Evaluation",
        "type": "Dataset",
        "subtype": "",
        "classification": "Language / Training Dataset",
        "organization": "Common Crawl Foundation",
        "originContext": "AI evaluation and dataset record",
        "firstPublicAppearance": "2008",
        "currentStatus": "Documented",
        "documentationStatus": "Documented",
        "documentationIndex": {
            "total": 74,
            "documentation": 25,
            "evidence": 13,
            "structure": 25,
            "relationships": 11,
            "level": "Level IV Connected"
        },
        "lxCalendarium": {
            "start_date_utc": "2023-04-01",
            "created_utc": "2026-06-16T23:59:14+00:00",
            "created_dypclt": "D-0 Y-2 P-3 C-3 L-21 T-3",
            "updated_utc": "2026-06-16T23:59:14+00:00",
            "updated_dypclt": "D-0 Y-2 P-3 C-3 L-21 T-3"
        },
        "facts": [],
        "capabilities": [
            "Evaluation reference",
            "Comparable measurement",
            "Research reproducibility",
            "Model documentation support"
        ],
        "limitations": [
            "Benchmark interpretation depends on task design, data quality and contamination controls.",
            "Scores should not be treated as a complete measure of intelligence."
        ],
        "tags": [
            "Dataset",
            "Evaluation",
            "Documentation",
            "Established",
            "Batch 03 Candidate"
        ],
        "timeline": [
            {
                "date": "2008",
                "title": "Initial dataset release",
                "description": "Common Crawl entered the documented public record in 2008. This event is retained at the precision supported by the Entry’s reviewed source history.",
                "source_url": "https://commoncrawl.org/",
                "verification_status": "source_backed_official"
            }
        ],
        "relationships": [
            {
                "target": "Common Crawl Foundation",
                "type": "Created or maintained by",
                "description": "Common Crawl is associated with Common Crawl Foundation.",
                "evidence_level": "documentary"
            }
        ],
        "sources": [
            {
                "label": "Common Crawl public reference",
                "url": "https://commoncrawl.org/",
                "source_type": "Primary or Research Source",
                "verification_status": "verified",
                "authority": "OFFICIAL",
                "role": "primary",
                "update_enabled": true,
                "authority_basis": "curated-corpus-refresh-2026-09-08"
            }
        ],
        "canonical": [],
        "imageMeta": []
    }
}
Preuves

Contribuer à cette entrée

Soumettez une source, une correction ou un commentaire. Les modifications publiques restent modérées.

Soumettre une preuve ou un commentaire

Commentaires approuvés

Aucun commentaire public approuvé pour le moment.