AI Benchmark
Autonomous EntityAI AssistantAI Answer EngineAI SystemSynthetic Personality PlatformSynthetic CompanionCreative IntelligenceVoice IntelligenceFictional IntelligenceAI OrganizationFoundation ModelHistorical AI SystemAgentic SystemRobotic IntelligenceDeveloper PlatformCreative Intelligence SystemRobotics and Embodied AIResearch SystemEvaluation SystemDatasetAI ToolAI InfrastructureScientific AI SystemEmbodied AI SystemCreative AI SystemSpecialized AI SystemAI AgentAI Research SystemAI Governance SystemAI FrameworkAI Training FrameworkAI KernelAI RuntimeMLOps PlatformSearch PlatformGraph AI PlatformRAG MethodLanguage ModelMachine Translation ModelSpeech ModelVision ModelAI DatasetAI BenchmarkScientific AI ModelScientific AI FrameworkAI HardwareEmbodied AIAI Writing SystemAI TutorAI Documentation AssistantFictional Synthetic PersonalityFictional Synthetic PersonMultimodal ModelMultimodal FrameworkVision FrameworkSpeech FrameworkAI Simulation PlatformAgentic AI SystemAI CompilerMachine Learning FrameworkEmbedding ModelReranker ModelMixture-of-Experts ModelCode ModelMachine Translation BenchmarkMachine Translation DatasetMedical AI DatasetMedical AI BenchmarkScientific DatasetScientific AI DatasetFictional RobotFictional Synthetic IntelligenceMath ModelAI Assistant ModelAI ArchitectureAI Alignment MethodReinforcement Learning MethodAI Reasoning MethodAutoML FrameworkWorkflow PlatformData PlatformAI Evaluation PlatformAI Observability PlatformAI GatewayImage Generation ModelImage Control ModelImage Fine-Tuning MethodAudio Generation ModelAudio Codec ModelSpeech Generation ModelAudio Generation FrameworkVoice Conversion SystemRobotics Simulation PlatformRobotics BenchmarkRobotics DatasetAI PlatformAI Search AssistantAI Data PlatformAI InterfaceRobotics SoftwareAI Safety ToolAI Evaluation FrameworkAI Safety ModelComputer Vision ModelAI Narrative SystemAI LibraryAI ModelDataset / BenchmarkOrganization / PlatformEmbodied AI / RoboticsBenchmark
WeatherBench
WeatherBench is a weather forecasting benchmark associated with Research community.
TREC
TREC is a text retrieval evaluation conference associated with NIST.
MTEB
MTEB is a massive text embedding benchmark associated with Hugging Face ecosystem.
QNLI
QNLI is a question-answer natural language inference task associated with GLUE Benchmark.
RTE
RTE is a recognizing textual entailment task associated with GLUE Benchmark.
STS-B
STS-B is a semantic textual similarity benchmark associated with SemEval.
Arcade Learning Environment
Arcade Learning Environment is a Atari reinforcement learning environment associated with Research community.
MiniGrid
MiniGrid is a gridworld reinforcement learning environment associated with Farama Foundation.
BabyAI
BabyAI is a language-grounded RL environment associated with Meta AI.
DeepMind Control Suite
DeepMind Control Suite is a continuous control benchmark associated with Google DeepMind.
DeepMind Lab
DeepMind Lab is a 3D learning environment associated with Google DeepMind.
NetHack Learning Environment
NetHack Learning Environment is a reinforcement learning environment associated with Meta AI.
Crafter
Crafter is a open-ended survival environment associated with Research community.
Meta-World
Meta-World is a robotic manipulation benchmark associated with Research community.
ARC-AGI
ARC-AGI is a abstraction and reasoning benchmark associated with ARC Prize Foundation.
Abstraction and Reasoning Corpus
Abstraction and Reasoning Corpus is a abstract reasoning benchmark associated with Research community.
BIRD-SQL
BIRD-SQL is a text-to-SQL benchmark associated with Research community.
PromptBench
PromptBench is a benchmarking framework for prompt robustness associated with Microsoft.
CyberSecEval
CyberSecEval is a cybersecurity evaluation benchmark suite associated with Meta.
MLE-bench
MLE-bench is a benchmark for machine learning engineering agents associated with OpenAI.
Cybench
Cybench is a cybersecurity benchmark for AI agents associated with Research community.