ENT-00003000 · Benchmark

BEIR Signal-1M

BEIR Signal-1M is a information retrieval benchmark task associated with BEIR.

Level V — PersistentActiveDocumented

Human readable record

Overview

BEIR Signal-1M is an information retrieval evaluation task associated with the BEIR benchmark framework. It supports zero-shot or cross-domain retrieval evaluation for dense and sparse retrieval systems.

Timeline

2021Public release or documentation
BEIR Signal-1M appears in public documentation, project records, benchmark descriptions or research references associated with BEIR.

Capabilities

Evaluation protocol documentationModel comparison supportTask taxonomy mappingReproducible benchmark anchoringRelationship graph compatibility

Known limitations

Benchmark results can become stale as models improve and evaluation protocols evolve.A benchmark measures a defined task scope rather than complete intelligence.

Technical and registry detail

Technical description

Structured record for BEIR Signal-1M. The technical layer identifies the entity type, classification, creator or organization, official source anchor, capabilities, limitations, timeline entries and graph relationships without adding internal import events to the public history.

Controlled tags

BenchmarkInformation RetrievalEvaluationBEIR

Relationship graph

BEIR Signal-1M

Associated organizationBEIR

BEIR is the organization, project community or institutional context associated with BEIR Signal-1M.

Domain contextInformation retrieval evaluation

BEIR Signal-1M belongs to the Information retrieval evaluation layer of the intelligent-entity registry.

Machine readable layer

Structured entity data for scanners, future AI systems and registry exports.

{
    "@context": "https://schema.org",
    "@type": "Thing",
    "identifier": "ENT-00003000",
    "name": "BEIR Signal-1M",
    "alternateName": [],
    "additionalType": "Benchmark",
    "description": "BEIR Signal-1M is a information retrieval benchmark task associated with BEIR.",
    "creator": "BEIR contributors",
    "url": "entity.php?id=ENT-00003000",
    "sameAs": "https://github.com/beir-cellar/beir",
    "lxkeysWorld": {
        "classification": "Information Retrieval Benchmark Task",
        "organization": "BEIR",
        "originContext": "Information retrieval evaluation",
        "firstPublicAppearance": "2021",
        "currentStatus": "Active",
        "registryStatus": "Documented",
        "spatiumIndex": {
            "total": 82,
            "documentation": 25,
            "evidence": 13,
            "structure": 25,
            "relationships": 19,
            "level": "Level V — Persistent"
        },
        "lxCalendarium": {
            "start_date_utc": "2023-04-01",
            "created_utc": "2026-06-17T01:48:33+00:00",
            "created_dypclt": "D-0 Y-2 P-3 C-3 L-22 T-4",
            "updated_utc": "2026-06-17T01:48:33+00:00",
            "updated_dypclt": "D-0 Y-2 P-3 C-3 L-22 T-4",
            "reviewed_utc": "2026-06-17T01:48:33+00:00",
            "reviewed_dypclt": "D-0 Y-2 P-3 C-3 L-22 T-4"
        },
        "capabilities": [
            "Evaluation protocol documentation",
            "Model comparison support",
            "Task taxonomy mapping",
            "Reproducible benchmark anchoring",
            "Relationship graph compatibility"
        ],
        "limitations": [
            "Benchmark results can become stale as models improve and evaluation protocols evolve.",
            "A benchmark measures a defined task scope rather than complete intelligence."
        ],
        "tags": [
            "Benchmark",
            "Information Retrieval",
            "Evaluation",
            "BEIR"
        ],
        "timeline": [
            {
                "date": "2021",
                "title": "Public release or documentation",
                "description": "BEIR Signal-1M appears in public documentation, project records, benchmark descriptions or research references associated with BEIR."
            }
        ],
        "relationships": [
            {
                "target": "BEIR",
                "type": "Associated organization",
                "description": "BEIR is the organization, project community or institutional context associated with BEIR Signal-1M.",
                "evidence_level": "documentary"
            },
            {
                "target": "Information retrieval evaluation",
                "type": "Domain context",
                "description": "BEIR Signal-1M belongs to the Information retrieval evaluation layer of the intelligent-entity registry.",
                "evidence_level": "documentary"
            }
        ],
        "sources": [
            {
                "label": "BEIR repository",
                "url": "https://github.com/beir-cellar/beir",
                "source_type": "Research Source",
                "verification_status": "verified"
            }
        ]
    }
}

Proof and discussion layer

Contribute to this record

Submit a proof, correction or comment. Public display is moderated. Every submission remains preserved in the export archive.

Submit proof or comment

Approved comments

No approved public comment yet.