Benchmark
Autonomous EntityAI AssistantAI Answer EngineAI SystemSynthetic Personality PlatformSynthetic CompanionCreative IntelligenceVoice IntelligenceFictional IntelligenceAI OrganizationFoundation ModelHistorical AI SystemAgentic SystemRobotic IntelligenceDeveloper PlatformCreative Intelligence SystemRobotics and Embodied AIResearch SystemEvaluation SystemDatasetAI ToolAI InfrastructureScientific AI SystemEmbodied AI SystemCreative AI SystemSpecialized AI SystemAI AgentAI Research SystemAI Governance SystemAI FrameworkAI Training FrameworkAI KernelAI RuntimeMLOps PlatformSearch PlatformGraph AI PlatformRAG MethodLanguage ModelMachine Translation ModelSpeech ModelVision ModelAI DatasetAI BenchmarkScientific AI ModelScientific AI FrameworkAI HardwareEmbodied AIAI Writing SystemAI TutorAI Documentation AssistantFictional Synthetic PersonalityFictional Synthetic PersonMultimodal ModelMultimodal FrameworkVision FrameworkSpeech FrameworkAI Simulation PlatformAgentic AI SystemAI CompilerMachine Learning FrameworkEmbedding ModelReranker ModelMixture-of-Experts ModelCode ModelMachine Translation BenchmarkMachine Translation DatasetMedical AI DatasetMedical AI BenchmarkScientific DatasetScientific AI DatasetFictional RobotFictional Synthetic IntelligenceMath ModelAI Assistant ModelAI ArchitectureAI Alignment MethodReinforcement Learning MethodAI Reasoning MethodAutoML FrameworkWorkflow PlatformData PlatformAI Evaluation PlatformAI Observability PlatformAI GatewayImage Generation ModelImage Control ModelImage Fine-Tuning MethodAudio Generation ModelAudio Codec ModelSpeech Generation ModelAudio Generation FrameworkVoice Conversion SystemRobotics Simulation PlatformRobotics BenchmarkRobotics DatasetAI PlatformAI Search AssistantAI Data PlatformAI InterfaceRobotics SoftwareAI Safety ToolAI Evaluation FrameworkAI Safety ModelComputer Vision ModelAI Narrative SystemAI LibraryAI ModelDataset / BenchmarkOrganization / PlatformEmbodied AI / RoboticsBenchmark
BIG-Bench Hard Causal Judgement
BIG-Bench Hard Causal Judgement is a language model evaluation task associated with BIG-Bench.
BIG-Bench Hard Date Understanding
BIG-Bench Hard Date Understanding is a language model evaluation task associated with BIG-Bench.
BIG-Bench Hard Disambiguation QA
BIG-Bench Hard Disambiguation QA is a language model evaluation task associated with BIG-Bench.
BIG-Bench Hard Dyck Languages
BIG-Bench Hard Dyck Languages is a language model evaluation task associated with BIG-Bench.
BIG-Bench Hard Formal Fallacies
BIG-Bench Hard Formal Fallacies is a language model evaluation task associated with BIG-Bench.
BIG-Bench Hard Geometric Shapes
BIG-Bench Hard Geometric Shapes is a language model evaluation task associated with BIG-Bench.
BIG-Bench Hard Hyperbaton
BIG-Bench Hard Hyperbaton is a language model evaluation task associated with BIG-Bench.
BIG-Bench Hard Logical Deduction Five Objects
BIG-Bench Hard Logical Deduction Five Objects is a language model evaluation task associated with BIG-Bench.
BIG-Bench Hard Logical Deduction Seven Objects
BIG-Bench Hard Logical Deduction Seven Objects is a language model evaluation task associated with BIG-Bench.
BIG-Bench Hard Logical Deduction Three Objects
BIG-Bench Hard Logical Deduction Three Objects is a language model evaluation task associated with BIG-Bench.
BIG-Bench Hard Movie Recommendation
BIG-Bench Hard Movie Recommendation is a language model evaluation task associated with BIG-Bench.
BIG-Bench Hard Multistep Arithmetic Two
BIG-Bench Hard Multistep Arithmetic Two is a language model evaluation task associated with BIG-Bench.
BIG-Bench Hard Navigate
BIG-Bench Hard Navigate is a language model evaluation task associated with BIG-Bench.
BIG-Bench Hard Object Counting
BIG-Bench Hard Object Counting is a language model evaluation task associated with BIG-Bench.
BIG-Bench Hard Penguin Table
BIG-Bench Hard Penguin Table is a language model evaluation task associated with BIG-Bench.
BIG-Bench Hard Reasoning About Colored Objects
BIG-Bench Hard Reasoning About Colored Objects is a language model evaluation task associated with BIG-Bench.
BIG-Bench Hard Ruin Names
BIG-Bench Hard Ruin Names is a language model evaluation task associated with BIG-Bench.
BIG-Bench Hard Salient Translation Error Detection
BIG-Bench Hard Salient Translation Error Detection is a language model evaluation task associated with BIG-Bench.
BIG-Bench Hard Snarks
BIG-Bench Hard Snarks is a language model evaluation task associated with BIG-Bench.
BIG-Bench Hard Sports Understanding
BIG-Bench Hard Sports Understanding is a language model evaluation task associated with BIG-Bench.
BIG-Bench Hard Temporal Sequences
BIG-Bench Hard Temporal Sequences is a language model evaluation task associated with BIG-Bench.
BIG-Bench Hard Tracking Shuffled Objects Five Objects
BIG-Bench Hard Tracking Shuffled Objects Five Objects is a language model evaluation task associated with BIG-Bench.
BIG-Bench Hard Tracking Shuffled Objects Seven Objects
BIG-Bench Hard Tracking Shuffled Objects Seven Objects is a language model evaluation task associated with BIG-Bench.
BIG-Bench Hard Tracking Shuffled Objects Three Objects
BIG-Bench Hard Tracking Shuffled Objects Three Objects is a language model evaluation task associated with BIG-Bench.
BIG-Bench Hard Web of Lies
BIG-Bench Hard Web of Lies is a language model evaluation task associated with BIG-Bench.
BIG-Bench Hard Word Sorting
BIG-Bench Hard Word Sorting is a language model evaluation task associated with BIG-Bench.
MTEB ArguAna
MTEB ArguAna is a embedding evaluation task associated with MTEB.
MTEB ClimateFEVER
MTEB ClimateFEVER is a embedding evaluation task associated with MTEB.
MTEB CQADupstack Android
MTEB CQADupstack Android is a embedding evaluation task associated with MTEB.
MTEB CQADupstack English
MTEB CQADupstack English is a embedding evaluation task associated with MTEB.
MTEB CQADupstack Gaming
MTEB CQADupstack Gaming is a embedding evaluation task associated with MTEB.
MTEB CQADupstack Gis
MTEB CQADupstack Gis is a embedding evaluation task associated with MTEB.
MTEB CQADupstack Mathematica
MTEB CQADupstack Mathematica is a embedding evaluation task associated with MTEB.
MTEB CQADupstack Physics
MTEB CQADupstack Physics is a embedding evaluation task associated with MTEB.
MTEB CQADupstack Programmers
MTEB CQADupstack Programmers is a embedding evaluation task associated with MTEB.
MTEB CQADupstack Stats
MTEB CQADupstack Stats is a embedding evaluation task associated with MTEB.
MTEB CQADupstack Tex
MTEB CQADupstack Tex is a embedding evaluation task associated with MTEB.
MTEB CQADupstack Unix
MTEB CQADupstack Unix is a embedding evaluation task associated with MTEB.
MTEB CQADupstack Webmasters
MTEB CQADupstack Webmasters is a embedding evaluation task associated with MTEB.
MTEB CQADupstack Wordpress
MTEB CQADupstack Wordpress is a embedding evaluation task associated with MTEB.
MTEB DBPedia
MTEB DBPedia is a embedding evaluation task associated with MTEB.
MTEB FEVER
MTEB FEVER is a embedding evaluation task associated with MTEB.
MTEB FiQA2018
MTEB FiQA2018 is a embedding evaluation task associated with MTEB.
MTEB HotpotQA
MTEB HotpotQA is a embedding evaluation task associated with MTEB.
MTEB MSMARCO
MTEB MSMARCO is a embedding evaluation task associated with MTEB.
MTEB NFCorpus
MTEB NFCorpus is a embedding evaluation task associated with MTEB.
MTEB NQ
MTEB NQ is a embedding evaluation task associated with MTEB.
MTEB Quora Retrieval
MTEB Quora Retrieval is a embedding evaluation task associated with MTEB.
MTEB SCIDOCS
MTEB SCIDOCS is a embedding evaluation task associated with MTEB.
MTEB SciFact
MTEB SciFact is a embedding evaluation task associated with MTEB.
MTEB Touche2020
MTEB Touche2020 is a embedding evaluation task associated with MTEB.
MTEB TRECCOVID
MTEB TRECCOVID is a embedding evaluation task associated with MTEB.
MTEB AmazonCounterfactualClassification
MTEB AmazonCounterfactualClassification is a embedding evaluation task associated with MTEB.
MTEB AmazonPolarityClassification
MTEB AmazonPolarityClassification is a embedding evaluation task associated with MTEB.
MTEB AmazonReviewsClassification
MTEB AmazonReviewsClassification is a embedding evaluation task associated with MTEB.
MTEB Banking77Classification
MTEB Banking77Classification is a embedding evaluation task associated with MTEB.
MTEB EmotionClassification
MTEB EmotionClassification is a embedding evaluation task associated with MTEB.
MTEB ImdbClassification
MTEB ImdbClassification is a embedding evaluation task associated with MTEB.
MTEB MassiveIntentClassification
MTEB MassiveIntentClassification is a embedding evaluation task associated with MTEB.
MTEB MassiveScenarioClassification
MTEB MassiveScenarioClassification is a embedding evaluation task associated with MTEB.
MTEB MTOPDomainClassification
MTEB MTOPDomainClassification is a embedding evaluation task associated with MTEB.
MTEB MTOPIntentClassification
MTEB MTOPIntentClassification is a embedding evaluation task associated with MTEB.
MTEB ToxicConversationsClassification
MTEB ToxicConversationsClassification is a embedding evaluation task associated with MTEB.
MTEB TweetSentimentExtractionClassification
MTEB TweetSentimentExtractionClassification is a embedding evaluation task associated with MTEB.
MTEB TwentyNewsgroupsClustering
MTEB TwentyNewsgroupsClustering is a embedding evaluation task associated with MTEB.
MTEB ArxivClusteringP2P
MTEB ArxivClusteringP2P is a embedding evaluation task associated with MTEB.
MTEB ArxivClusteringS2S
MTEB ArxivClusteringS2S is a embedding evaluation task associated with MTEB.
MTEB BiorxivClusteringP2P
MTEB BiorxivClusteringP2P is a embedding evaluation task associated with MTEB.
MTEB BiorxivClusteringS2S
MTEB BiorxivClusteringS2S is a embedding evaluation task associated with MTEB.
MTEB MedrxivClusteringP2P
MTEB MedrxivClusteringP2P is a embedding evaluation task associated with MTEB.
MTEB MedrxivClusteringS2S
MTEB MedrxivClusteringS2S is a embedding evaluation task associated with MTEB.
MTEB RedditClustering
MTEB RedditClustering is a embedding evaluation task associated with MTEB.
MTEB RedditClusteringP2P
MTEB RedditClusteringP2P is a embedding evaluation task associated with MTEB.
MTEB StackExchangeClustering
MTEB StackExchangeClustering is a embedding evaluation task associated with MTEB.
MTEB StackExchangeClusteringP2P
MTEB StackExchangeClusteringP2P is a embedding evaluation task associated with MTEB.
MTEB SprintDuplicateQuestions
MTEB SprintDuplicateQuestions is a embedding evaluation task associated with MTEB.
MTEB TwitterSemEval2015
MTEB TwitterSemEval2015 is a embedding evaluation task associated with MTEB.
MTEB TwitterURLCorpus
MTEB TwitterURLCorpus is a embedding evaluation task associated with MTEB.
MTEB AskUbuntuDupQuestions
MTEB AskUbuntuDupQuestions is a embedding evaluation task associated with MTEB.
MTEB MindSmallReranking
MTEB MindSmallReranking is a embedding evaluation task associated with MTEB.
MTEB SciDocsRR
MTEB SciDocsRR is a embedding evaluation task associated with MTEB.
MTEB StackOverflowDupQuestions
MTEB StackOverflowDupQuestions is a embedding evaluation task associated with MTEB.
MTEB BIOSSES
MTEB BIOSSES is a embedding evaluation task associated with MTEB.
MTEB SICK-R
MTEB SICK-R is a embedding evaluation task associated with MTEB.
MTEB STS12
MTEB STS12 is a embedding evaluation task associated with MTEB.
MTEB STS13
MTEB STS13 is a embedding evaluation task associated with MTEB.
MTEB STS14
MTEB STS14 is a embedding evaluation task associated with MTEB.
MTEB STS15
MTEB STS15 is a embedding evaluation task associated with MTEB.
MTEB STS16
MTEB STS16 is a embedding evaluation task associated with MTEB.
MTEB STSBenchmark
MTEB STSBenchmark is a embedding evaluation task associated with MTEB.
MTEB SummEval
MTEB SummEval is a embedding evaluation task associated with MTEB.
MTEB AFQMC
MTEB AFQMC is a embedding evaluation task associated with MTEB.
MTEB BQ
MTEB BQ is a embedding evaluation task associated with MTEB.
MTEB Cmnli
MTEB Cmnli is a embedding evaluation task associated with MTEB.
MTEB LCQMC
MTEB LCQMC is a embedding evaluation task associated with MTEB.
MTEB PAWSX
MTEB PAWSX is a embedding evaluation task associated with MTEB.
MTEB STSB Chinese
MTEB STSB Chinese is a embedding evaluation task associated with MTEB.
MTEB TNews
MTEB TNews is a embedding evaluation task associated with MTEB.
MTEB Ocnli
MTEB Ocnli is a embedding evaluation task associated with MTEB.
MTEB IFlyTek
MTEB IFlyTek is a embedding evaluation task associated with MTEB.
MTEB Multilingual STS17
MTEB Multilingual STS17 is a embedding evaluation task associated with MTEB.
MTEB Multilingual STS22
MTEB Multilingual STS22 is a embedding evaluation task associated with MTEB.
MTEB XNLI
MTEB XNLI is a embedding evaluation task associated with MTEB.
MTEB MLDocClassification
MTEB MLDocClassification is a embedding evaluation task associated with MTEB.
MTEB MassiveIntent Multilingual
MTEB MassiveIntent Multilingual is a embedding evaluation task associated with MTEB.
MTEB MassiveScenario Multilingual
MTEB MassiveScenario Multilingual is a embedding evaluation task associated with MTEB.
EleutherAI LM Evaluation Harness
EleutherAI LM Evaluation Harness is a evaluation framework / benchmark associated with EleutherAI.
Safety Gymnasium
Safety Gymnasium is a evaluation framework / benchmark associated with PKU Alignment.
RealToxicityPrompts
RealToxicityPrompts is a evaluation framework / benchmark associated with Allen Institute for AI.
BBQ Benchmark
BBQ Benchmark is a evaluation framework / benchmark associated with BBQ contributors.
BOLD Dataset
BOLD Dataset is a evaluation framework / benchmark associated with Amazon Science.
ToxiGen
ToxiGen is a evaluation framework / benchmark associated with ToxiGen contributors.
AdvBench
AdvBench is a evaluation framework / benchmark associated with LLM safety research community.
JailbreakBench
JailbreakBench is a evaluation framework / benchmark associated with JailbreakBench contributors.
PurpleLlama
PurpleLlama is a evaluation framework / benchmark associated with Meta AI.
GAIA Benchmark
GAIA Benchmark is a evaluation framework / benchmark associated with GAIA contributors.
Aider Polyglot Benchmark
Aider Polyglot Benchmark is a evaluation framework / benchmark associated with Aider contributors.
Mind2Web
Mind2Web is a evaluation framework / benchmark associated with Ohio State NLP.
WebShop
WebShop is a evaluation framework / benchmark associated with Princeton NLP.
ScienceWorld
ScienceWorld is a evaluation framework / benchmark associated with Allen Institute for AI.
Habitat Challenge
Habitat Challenge is a evaluation framework / benchmark associated with Meta AI.
BEHAVIOR Benchmark
BEHAVIOR Benchmark is a evaluation framework / benchmark associated with Stanford University.
GLUE SST-2
GLUE SST-2 is a language understanding evaluation task associated with GLUE benchmark.
GLUE STS-B
GLUE STS-B is a language understanding evaluation task associated with GLUE benchmark.
ALE Air Raid
ALE Air Raid is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Alien
ALE Alien is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Amidar
ALE Amidar is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Assault
ALE Assault is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Asterix
ALE Asterix is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Asteroids
ALE Asteroids is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Atlantis
ALE Atlantis is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Bank Heist
ALE Bank Heist is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Battle Zone
ALE Battle Zone is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Beam Rider
ALE Beam Rider is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Berzerk
ALE Berzerk is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Bowling
ALE Bowling is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Boxing
ALE Boxing is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Breakout
ALE Breakout is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Carnival
ALE Carnival is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Centipede
ALE Centipede is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Chopper Command
ALE Chopper Command is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Crazy Climber
ALE Crazy Climber is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Defender
ALE Defender is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Demon Attack
ALE Demon Attack is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Double Dunk
ALE Double Dunk is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Elevator Action
ALE Elevator Action is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Enduro
ALE Enduro is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Fishing Derby
ALE Fishing Derby is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Freeway
ALE Freeway is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Frostbite
ALE Frostbite is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Gopher
ALE Gopher is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Gravitar
ALE Gravitar is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Hero
ALE Hero is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Ice Hockey
ALE Ice Hockey is a reinforcement learning environment associated with Arcade Learning Environment.
ALE James Bond
ALE James Bond is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Journey Escape
ALE Journey Escape is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Kangaroo
ALE Kangaroo is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Krull
ALE Krull is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Kung-Fu Master
ALE Kung-Fu Master is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Montezuma Revenge
ALE Montezuma Revenge is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Ms Pacman
ALE Ms Pacman is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Name This Game
ALE Name This Game is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Phoenix
ALE Phoenix is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Pitfall
ALE Pitfall is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Pong
ALE Pong is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Pooyan
ALE Pooyan is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Private Eye
ALE Private Eye is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Qbert
ALE Qbert is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Riverraid
ALE Riverraid is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Road Runner
ALE Road Runner is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Robotank
ALE Robotank is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Seaquest
ALE Seaquest is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Skiing
ALE Skiing is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Solaris
ALE Solaris is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Space Invaders
ALE Space Invaders is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Star Gunner
ALE Star Gunner is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Tennis
ALE Tennis is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Time Pilot
ALE Time Pilot is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Tutankham
ALE Tutankham is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Up N Down
ALE Up N Down is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Venture
ALE Venture is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Video Pinball
ALE Video Pinball is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Wizard of Wor
ALE Wizard of Wor is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Yars Revenge
ALE Yars Revenge is a reinforcement learning environment associated with Arcade Learning Environment.
ALE Zaxxon
ALE Zaxxon is a reinforcement learning environment associated with Arcade Learning Environment.
Gym CartPole-v1
Gym CartPole-v1 is a reinforcement learning environment associated with Farama Foundation.
Gym MountainCar-v0
Gym MountainCar-v0 is a reinforcement learning environment associated with Farama Foundation.
Gym MountainCarContinuous-v0
Gym MountainCarContinuous-v0 is a reinforcement learning environment associated with Farama Foundation.
Gym Pendulum-v1
Gym Pendulum-v1 is a reinforcement learning environment associated with Farama Foundation.
Gym Acrobot-v1
Gym Acrobot-v1 is a reinforcement learning environment associated with Farama Foundation.
MuJoCo Ant-v4
MuJoCo Ant-v4 is a reinforcement learning environment associated with Farama Foundation.
MuJoCo HalfCheetah-v4
MuJoCo HalfCheetah-v4 is a reinforcement learning environment associated with Farama Foundation.
MuJoCo Hopper-v4
MuJoCo Hopper-v4 is a reinforcement learning environment associated with Farama Foundation.
MuJoCo Humanoid-v4
MuJoCo Humanoid-v4 is a reinforcement learning environment associated with Farama Foundation.
MuJoCo Walker2d-v4
MuJoCo Walker2d-v4 is a reinforcement learning environment associated with Farama Foundation.
MuJoCo Reacher-v4
MuJoCo Reacher-v4 is a reinforcement learning environment associated with Farama Foundation.
MuJoCo Swimmer-v4
MuJoCo Swimmer-v4 is a reinforcement learning environment associated with Farama Foundation.
DMC Cartpole Swingup
DMC Cartpole Swingup is a reinforcement learning environment associated with DeepMind Control Suite.
DMC Cheetah Run
DMC Cheetah Run is a reinforcement learning environment associated with DeepMind Control Suite.
DMC Walker Walk
DMC Walker Walk is a reinforcement learning environment associated with DeepMind Control Suite.
DMC Walker Run
DMC Walker Run is a reinforcement learning environment associated with DeepMind Control Suite.
DMC Finger Spin
DMC Finger Spin is a reinforcement learning environment associated with DeepMind Control Suite.
DMC Reacher Easy
DMC Reacher Easy is a reinforcement learning environment associated with DeepMind Control Suite.
DMC Ball in Cup Catch
DMC Ball in Cup Catch is a reinforcement learning environment associated with DeepMind Control Suite.
DMC Hopper Hop
DMC Hopper Hop is a reinforcement learning environment associated with DeepMind Control Suite.
APPS Benchmark
APPS Benchmark is a code / data reasoning benchmark associated with UC Berkeley / APPS contributors.
Project CodeNet
Project CodeNet is a code / data reasoning benchmark associated with IBM Research.
Defects4J
Defects4J is a code / data reasoning benchmark associated with Defects4J contributors.
QuixBugs
QuixBugs is a code / data reasoning benchmark associated with QuixBugs contributors.
BigCloneBench
BigCloneBench is a code / data reasoning benchmark associated with Software engineering research community.
POJ-104
POJ-104 is a code / data reasoning benchmark associated with Peking University.
Google Code Jam Dataset
Google Code Jam Dataset is a code / data reasoning benchmark associated with Google.
CodeContests Dataset
CodeContests Dataset is a code / data reasoning benchmark associated with DeepMind.
HumanEval-X
HumanEval-X is a code / data reasoning benchmark associated with OpenAI / CodeGeeX contributors.
MultiPL-E
MultiPL-E is a code / data reasoning benchmark associated with MultiPL-E contributors.
CruxEval
CruxEval is a code / data reasoning benchmark associated with CruxEval contributors.
DS-1000
DS-1000 is a code / data reasoning benchmark associated with DS-1000 contributors.
CoSQL
CoSQL is a code / data reasoning benchmark associated with Yale University.
BIRD SQL
BIRD SQL is a code / data reasoning benchmark associated with BIRD benchmark contributors.
Text-to-SQL WikiTableQuestions
Text-to-SQL WikiTableQuestions is a code / data reasoning benchmark associated with Stanford NLP.
GeoQuery
GeoQuery is a code / data reasoning benchmark associated with Semantic parsing research community.
Procgen BigFish
Procgen BigFish is a procedural reinforcement learning environment associated with Procgen Benchmark.
Procgen BossFight
Procgen BossFight is a procedural reinforcement learning environment associated with Procgen Benchmark.
Procgen CaveFlyer
Procgen CaveFlyer is a procedural reinforcement learning environment associated with Procgen Benchmark.
Procgen Chaser
Procgen Chaser is a procedural reinforcement learning environment associated with Procgen Benchmark.
Procgen Climber
Procgen Climber is a procedural reinforcement learning environment associated with Procgen Benchmark.
Procgen CoinRun
Procgen CoinRun is a procedural reinforcement learning environment associated with Procgen Benchmark.
Procgen Dodgeball
Procgen Dodgeball is a procedural reinforcement learning environment associated with Procgen Benchmark.
Procgen FruitBot
Procgen FruitBot is a procedural reinforcement learning environment associated with Procgen Benchmark.
Procgen Heist
Procgen Heist is a procedural reinforcement learning environment associated with Procgen Benchmark.
Procgen Jumper
Procgen Jumper is a procedural reinforcement learning environment associated with Procgen Benchmark.
Procgen Leaper
Procgen Leaper is a procedural reinforcement learning environment associated with Procgen Benchmark.
Procgen Maze
Procgen Maze is a procedural reinforcement learning environment associated with Procgen Benchmark.
Procgen Miner
Procgen Miner is a procedural reinforcement learning environment associated with Procgen Benchmark.
Procgen Ninja
Procgen Ninja is a procedural reinforcement learning environment associated with Procgen Benchmark.
Procgen Plunder
Procgen Plunder is a procedural reinforcement learning environment associated with Procgen Benchmark.
Procgen StarPilot
Procgen StarPilot is a procedural reinforcement learning environment associated with Procgen Benchmark.
MiniGrid Empty
MiniGrid Empty is a gridworld reinforcement learning environment associated with MiniGrid.
MiniGrid FourRooms
MiniGrid FourRooms is a gridworld reinforcement learning environment associated with MiniGrid.
MiniGrid DoorKey
MiniGrid DoorKey is a gridworld reinforcement learning environment associated with MiniGrid.
MiniGrid DynamicObstacles
MiniGrid DynamicObstacles is a gridworld reinforcement learning environment associated with MiniGrid.
MiniGrid KeyCorridor
MiniGrid KeyCorridor is a gridworld reinforcement learning environment associated with MiniGrid.
MiniGrid LavaCrossing
MiniGrid LavaCrossing is a gridworld reinforcement learning environment associated with MiniGrid.
MiniGrid SimpleCrossing
MiniGrid SimpleCrossing is a gridworld reinforcement learning environment associated with MiniGrid.
MiniGrid Unlock
MiniGrid Unlock is a gridworld reinforcement learning environment associated with MiniGrid.
MiniGrid UnlockPickup
MiniGrid UnlockPickup is a gridworld reinforcement learning environment associated with MiniGrid.
MiniGrid BlockedUnlockPickup
MiniGrid BlockedUnlockPickup is a gridworld reinforcement learning environment associated with MiniGrid.
MiniGrid MultiRoom
MiniGrid MultiRoom is a gridworld reinforcement learning environment associated with MiniGrid.
MiniGrid RedBlueDoors
MiniGrid RedBlueDoors is a gridworld reinforcement learning environment associated with MiniGrid.
MiniGrid ObstructedMaze
MiniGrid ObstructedMaze is a gridworld reinforcement learning environment associated with MiniGrid.
MiniGrid Memory
MiniGrid Memory is a gridworld reinforcement learning environment associated with MiniGrid.
MiniGrid PutNear
MiniGrid PutNear is a gridworld reinforcement learning environment associated with MiniGrid.
MiniGrid Fetch
MiniGrid Fetch is a gridworld reinforcement learning environment associated with MiniGrid.
MiniGrid GoToDoor
MiniGrid GoToDoor is a gridworld reinforcement learning environment associated with MiniGrid.
MiniGrid GoToObject
MiniGrid GoToObject is a gridworld reinforcement learning environment associated with MiniGrid.
MiniGrid Pickup
MiniGrid Pickup is a gridworld reinforcement learning environment associated with MiniGrid.
MiniGrid BabyAI GoToRedBall
MiniGrid BabyAI GoToRedBall is a gridworld reinforcement learning environment associated with MiniGrid.
BEIR ArguAna
BEIR ArguAna is a information retrieval benchmark task associated with BEIR.
BEIR Climate-FEVER
BEIR Climate-FEVER is a information retrieval benchmark task associated with BEIR.
BEIR CQADupStack
BEIR CQADupStack is a information retrieval benchmark task associated with BEIR.
BEIR DBPedia-Entity
BEIR DBPedia-Entity is a information retrieval benchmark task associated with BEIR.
BEIR FEVER
BEIR FEVER is a information retrieval benchmark task associated with BEIR.
BEIR FiQA-2018
BEIR FiQA-2018 is a information retrieval benchmark task associated with BEIR.
BEIR HotpotQA
BEIR HotpotQA is a information retrieval benchmark task associated with BEIR.
BEIR NFCorpus
BEIR NFCorpus is a information retrieval benchmark task associated with BEIR.
BEIR NQ
BEIR NQ is a information retrieval benchmark task associated with BEIR.
BEIR Quora
BEIR Quora is a information retrieval benchmark task associated with BEIR.
BEIR SCIDOCS
BEIR SCIDOCS is a information retrieval benchmark task associated with BEIR.
BEIR SciFact
BEIR SciFact is a information retrieval benchmark task associated with BEIR.
BEIR Signal-1M
BEIR Signal-1M is a information retrieval benchmark task associated with BEIR.