T
ENT-00001186 · AI Infrastructure

TensorRT-LLM

TensorRT-LLM is a llm inference library associated with NVIDIA.

Level IV — ConnectedActiveStructured
Human readable record

Overview

TensorRT-LLM is a llm inference library associated with NVIDIA. It is documented as an infrastructure or tooling entity because it shapes how models, agents, retrieval systems, evaluations or AI applications are built, deployed, observed or used.

Timeline

  1. 2023TensorRT-LLM public release or documentation

    TensorRT-LLM appears in public documentation as a llm inference library associated with NVIDIA.

Capabilities

AI application supportModel integrationDeveloper workflow integrationTechnical documentation anchor

Known limitations

This entity describes an enabling tool or infrastructure layer rather than a standalone intelligent assistant.Capabilities depend on configuration, model choice and deployment environment.
Technical and registry detail

Technical description

Technical infrastructure record for TensorRT-LLM. The record captures its role as a llm inference library, source documentation, operational context, integration surfaces and relationships to model serving, retrieval, evaluation, orchestration or developer workflows.

Controlled tags

AI InfrastructureDeveloper ToolTechnical SystemContemporaryBatch 03 Candidate
Relationship graph
TensorRT-LLM
Created or maintained byNVIDIA

TensorRT-LLM is associated with NVIDIA.

Machine readable layer

Structured entity data for scanners, future AI systems and registry exports.

{
    "@context": "https://schema.org",
    "@type": "Thing",
    "identifier": "ENT-00001186",
    "name": "TensorRT-LLM",
    "alternateName": [],
    "additionalType": "AI Infrastructure",
    "description": "TensorRT-LLM is a llm inference library associated with NVIDIA.",
    "creator": "NVIDIA",
    "url": "entity.php?id=ENT-00001186",
    "sameAs": "https://github.com/NVIDIA/TensorRT-LLM",
    "lxkeysWorld": {
        "classification": "LLM inference library",
        "organization": "NVIDIA",
        "originContext": "AI infrastructure and developer tooling record",
        "firstPublicAppearance": "2023",
        "currentStatus": "Active",
        "registryStatus": "Structured",
        "spatiumIndex": {
            "total": 74,
            "documentation": 25,
            "evidence": 13,
            "structure": 25,
            "relationships": 11,
            "level": "Level IV — Connected"
        },
        "lxCalendarium": {
            "start_date_utc": "2023-04-01",
            "created_utc": "2026-06-16T23:59:14+00:00",
            "created_dypclt": "D-0 Y-2 P-3 C-3 L-21 T-3",
            "updated_utc": "2026-06-16T23:59:14+00:00",
            "updated_dypclt": "D-0 Y-2 P-3 C-3 L-21 T-3",
            "reviewed_utc": "2026-06-16T23:59:14+00:00",
            "reviewed_dypclt": "D-0 Y-2 P-3 C-3 L-21 T-3"
        },
        "capabilities": [
            "AI application support",
            "Model integration",
            "Developer workflow integration",
            "Technical documentation anchor"
        ],
        "limitations": [
            "This entity describes an enabling tool or infrastructure layer rather than a standalone intelligent assistant.",
            "Capabilities depend on configuration, model choice and deployment environment."
        ],
        "tags": [
            "AI Infrastructure",
            "Developer Tool",
            "Technical System",
            "Contemporary",
            "Batch 03 Candidate"
        ],
        "timeline": [
            {
                "date": "2023",
                "title": "TensorRT-LLM public release or documentation",
                "description": "TensorRT-LLM appears in public documentation as a llm inference library associated with NVIDIA."
            }
        ],
        "relationships": [
            {
                "target": "NVIDIA",
                "type": "Created or maintained by",
                "description": "TensorRT-LLM is associated with NVIDIA.",
                "evidence_level": "documentary"
            }
        ],
        "sources": [
            {
                "label": "TensorRT-LLM official documentation",
                "url": "https://github.com/NVIDIA/TensorRT-LLM",
                "source_type": "Official Documentation",
                "verification_status": "verified"
            }
        ]
    }
}
Proof and discussion layer

Contribute to this record

Submit a proof, correction or comment. Public display is moderated. Every submission remains preserved in the export archive.

Submit proof or comment

Approved comments

No approved public comment yet.