video for world models: 135 catalogue datasets
Rows 1 to 100, sorted by hours, datasets that do not state it last.
Next page: https://datasets.gurasees.com/kinds/video-for-world-models.md?offset=100
| dataset | kind | robot class | hours | episodes | year | licence | access | id |
|---|---|---|---|---|---|---|---|---|
| InternVid | video for world models | other | 760,000 | 2023 | not stated | open | internvid | |
| HD-VILA-100M | video for world models | other | 371,500 | 2021 | not stated | not stated | hd-vila-100m | |
| MineDojo YouTube database | video for world models | simulation | 300,000 | 2022 | not stated | open | minedojo-youtube-database | |
| Koala-36M | video for world models | other | 172,000 | 2024 | not stated | open | koala-36m | |
| Panda-70M | video for world models | other | 166,800 | 2024 | not stated | open | panda-70m | |
| HowTo100M | video for world models | other | 134,472 | 2019 | not stated | on request | howto100m | |
| DreamDojo-HV | egocentric | human egocentric | 44,000 | 2026 | unclear | open | dreamdojo-hv | |
| NitroGen | video for world models | other | 40,000 | 2025 | non commercial | open | nitrogen | |
| MMTrail | video for world models | other | 27,100 | 2024 | unclear | open | mmtrail | |
| A global dataset of continuous urban dashcam driving | video for world models | vehicle | 20,276 | 2026 | not stated | open | a-global-dataset-of-continuous-urban-dashcam-driving | |
| OpenHumanVid | video for world models | other | 16,700 | 2024 | custom terms | gated | openhumanvid | |
| RoVid-X (with RBench) | video for world models | cross embodiment | 10,000 | 2026 | open | open | rovid-x-with-rbench | |
| Open P2P gameplay dataset | video for world models | simulation | 8,300 | 2026 | unclear | open | open-p2p-gameplay-dataset | |
| NVIDIA PhysicalAI WorldModel Synthetic series (5 repos) | video for world models | simulation | 7,720 | 2026 | open | open | nvidia-physicalai-worldmodel-synthetic-series-5-repos | |
| SpatialVID | video for world models | sensor only | 7,089 | 2025 | non commercial | gated | spatialvid | |
| SDG-SynHuman (PhysicalAI-WorldModel-Synthetic-Digital-Human-Scenes) | video for world models | simulation | 5,841 | 2026 | custom terms | open | sdg-synhuman-physicalai-worldmodel-synthetic-digital-human-scenes | |
| VPT contractor data | video for world models | simulation | 4,500 | 2022 | unclear | not stated | vpt-contractor-data | |
| ScenePilot-4K | video for world models | vehicle | 3,847 | 2026 | not stated | open | scenepilot-4k | |
| 100 Days of Hands (100DOH) | video for world models | other | 3,144 | 2020 | not stated | open | 100-days-of-hands-100doh | |
| Sekai2 | video for world models | human egocentric | 2,826 | 2026 | custom terms | open | sekai2 | |
| OpenVid-1M | video for world models | other | 2,051 | 2024 | open | open | openvid-1m | |
| CityWalker | video for world models | human egocentric | 2,000 | 2024 | not stated | open | citywalker | |
| OpenDV-2K | video for world models | vehicle | 2,000 | 2024 | not stated | open | opendv-2k | |
| OpenDV-YouTube | video for world models | vehicle | 1,700 | 2024 | non commercial | open | opendv-youtube | |
| commaVQ | video for world models | vehicle | 1,667 | 2023 | open | open | commavq | |
| Vript | video for world models | other | 1,300 | 2024 | not stated | not stated | vript | |
| LARYBench | video for world models | cross embodiment | 1,000 | 595,000 | 2026 | non commercial | open | larybench |
| AirScape dataset | video for world models | aerial | 1,000 | 2025 | not stated | not stated | airscape-dataset | |
| DENSEWORLD (DENSEWORLD-115k) | video for world models | sensor only | 1,000 | 2026 | not stated | not stated | denseworld-denseworld-115k | |
| ActivityNet | video for world models | other | 849 | 2015 | not stated | not stated | activitynet | |
| PhysicalAI-WorldModel-Synthetic-Physical-Interaction-Scenes | video for world models | simulation | 528 | 2026 | unclear | open | physicalai-worldmodel-synthetic-physical-interaction-scenes | |
| COIN | video for world models | other | 477 | 2019 | not stated | open | coin | |
| MMBench2 | video for world models | simulation | 427 | 2026 | open | open | mmbench2 | |
| NVIDIA PhysicalAI Synthetic Warehouse Operations Scenes | synthetic or generated | simulation | 412 | 2026 | unclear | open | nvidia-physicalai-synthetic-warehouse-operations-scenes | |
| CrossTask | video for world models | other | 376 | 2019 | not stated | open | crosstask | |
| Cosmos3-DROID | video for world models | single arm | 350 | 76,000 | 2026 | open | open | cosmos3-droid |
| LoopNav | video for world models | simulation | 250 | 2025 | not stated | open | loopnav | |
| OmniWorld | video for world models | other | 214 | 2025 | non commercial | open | omniworld | |
| PLAICraft | video for world models | simulation | 200 | 2025 | not stated | not stated | plaicraft | |
| DroneMotion-99k | video for world models | aerial | 180 | 99,000 | 2024 | open | open | dronemotion-99k |
| YouCook2 | video for world models | other | 176 | 2017 | not stated | open | youcook2 | |
| DrivingDojo | video for world models | vehicle | 150 | 2024 | open | gated | drivingdojo | |
| X-Ego-CS | video for world models | simulation | 124 | 2025 | open | open | x-ego-cs | |
| YouTube Driving (ACO) | video for world models | vehicle | 120 | 2022 | not stated | open | youtube-driving-aco | |
| Atari-HEAD | video for world models | simulation | 117 | 8,000,000 | 2019 | not stated | open | atari-head |
| 1X World Model raw data | video for world models | humanoid | 104 | 2024 | non commercial | open | 1x-world-model-raw-data | |
| 1X World Model Challenge dataset | teleop | humanoid | 100 | 2024 | non commercial | open | 1x-world-model-challenge-dataset | |
| CS:GO behavioural cloning dataset | video for world models | simulation | 95 | 2021 | not stated | not stated | cs-go-behavioural-cloning-dataset | |
| Breakfast Actions | video for world models | other | 77 | 2014 | open | open | breakfast-actions | |
| GF-Minecraft (GameFactory) | video for world models | simulation | 70 | 2025 | not stated | open | gf-minecraft-gamefactory | |
| WorldRover-6scenes | video for world models | sensor only | 37.9 | 2026 | custom terms | open | worldrover-6scenes | |
| IntPhys | video for world models | simulation | 21 | 2018 | not stated | open | intphys | |
| DexWM dataset | video for world models | dexterous hand | 4 | 2026 | non commercial | open | dexwm-dataset | |
| WayveScenes101 | video for world models | vehicle | 2.8 | 2024 | not stated | open | wayvescenes101 | |
| Waymo Block-NeRF dataset | video for world models | vehicle | 0 | 2022 | not stated | gated | waymo-block-nerf-dataset | |
| DL3DV-10K | video for world models | sensor only | 2023 | not stated | gated | dl3dv-10k | ||
| HumanGen | video for world models | other | 2026 | open | open | humangen | ||
| ViPE wild SDG 1M | video for world models | sensor only | 2025 | non commercial | open | vipe-wild-sdg-1m | ||
| PointWorld-DROID | video for world models | single arm | 2026 | not stated | open | pointworld-droid | ||
| DrivingGen | video for world models | vehicle | 2026 | open | open | drivinggen | ||
| IntPhys 2 | video for world models | simulation | 2025 | non commercial | open | intphys-2 | ||
| AgiBot World Challenge 2025 dataset | teleop | mobile manipulator | 30,000 | 2025 | non commercial | open | agibot-world-challenge-2025-dataset | |
| WorldArena 2.0 | video for world models | cross embodiment | 2026 | open | open | worldarena-2-0 | ||
| Morpheus real-world physics videos | video for world models | sensor only | 2025 | open | open | morpheus-real-world-physics-videos | ||
| PAI-Bench (Physical AI Bench) | video for world models | cross embodiment | 2025 | non commercial | open | pai-bench-physical-ai-bench | ||
| GAUGE | video for world models | sensor only | 2026 | open | open | gauge | ||
| WISA-80K | video for world models | other | 2025 | open | open | wisa-80k | ||
| Physics-IQ Verified | video for world models | sensor only | 2026 | open | gated | physics-iq-verified | ||
| WorldArena (RoboTwin 2.0 set) | video for world models | bimanual | 50 | 2026 | open | open | worldarena-robotwin-2-0-set | |
| IRASim data | video for world models | single arm | 2024 | not stated | open | irasim-data | ||
| Rapidata world model physics human preference 283k | video for world models | other | 2026 | open | open | rapidata-world-model-physics-human-preference-283k | ||
| PhyGround | video for world models | other | 2026 | open | open | phyground | ||
| Action100M | video for world models | other | claims 127,984 | 2026 | non commercial | open | action100m | |
| Bleeding Edge gameplay data (WHAM 7 Maps) | video for world models | simulation | claims 61,362 | 2025 | non commercial | not stated | bleeding-edge-gameplay-data-wham-7-maps | |
| Physion-Eval | video for world models | other | 2026 | custom terms | open | physion-eval | ||
| MiraData | video for world models | other | claims 16,000 | 2024 | open | open | miradata | |
| VideoPhy-2 | video for world models | other | 2025 | open | open | videophy-2 | ||
| GigaWorld-1 toy data (WMBench) | video for world models | other | claims 12,000 | 2026 | open | open | gigaworld-1-toy-data-wmbench | |
| WorldScore | video for world models | other | 2025 | open | open | worldscore | ||
| Something-Something V2 | video for world models | other | 2017 | custom terms | on request | something-something-v2 | ||
| ReMind1M | video for world models | other | 2026 | custom terms | open | remind1m | ||
| ACT-Bench | video for world models | vehicle | 2024 | open | open | act-bench | ||
| CS2-10k | video for world models | other | claims 10,000 | 2026 | non commercial | open | cs2-10k | |
| KineBench | video for world models | single arm | 2026 | open | open | kinebench | ||
| WoW-1 Benchmark Samples (WoWBench) | video for world models | cross embodiment | 2025 | open | open | wow-1-benchmark-samples-wowbench | ||
| WorldModelBench | video for world models | other | 2025 | not stated | open | worldmodelbench | ||
| VideoPhy | video for world models | other | 2024 | open | open | videophy | ||
| EWMBench | video for world models | humanoid | 2025 | non commercial | open | ewmbench | ||
| GigaBrain Challenge 2026 World Model Track dataset (CVPR 2026) | video for world models | other | 2026 | custom terms | gated | gigabrain-challenge-2026-world-model-track-dataset-cvpr-2026 | ||
| go2-wm-indoor-1hr | video for world models | legged | 2025 | open | open | go2-wm-indoor-1hr | ||
| RoboTransfer SimData | video for world models | simulation | 2025 | open | open | robotransfer-simdata | ||
| EVA-Bench | video for world models | cross embodiment | 2024 | not stated | not stated | eva-bench | ||
| H2R-Bench | video for world models | cross embodiment | 2026 | not stated | not stated | h2r-bench | ||
| OPIS | video for world models | cross embodiment | 2026 | not stated | not stated | opis | ||
| RoboGaze benchmark | video for world models | cross embodiment | 2026 | not stated | not stated | robogaze-benchmark | ||
| RoboWM-Bench | video for world models | cross embodiment | 2026 | not stated | open | robowm-bench | ||
| TesserAct RGB-DN video data | video for world models | cross embodiment | 2025 | not stated | not stated | tesseract-rgb-dn-video-data | ||
| WorldSimBench (HF-Embodied dataset) | video for world models | cross embodiment | 2024 | not stated | not stated | worldsimbench-hf-embodied-dataset | ||
| Ego2Act | video for world models | human egocentric | 2026 | not stated | not stated | ego2act | ||
| DreamGen Bench (GR00T-Dreams) | video for world models | humanoid | 2025 | not stated | open | dreamgen-bench-gr00t-dreams |
Everything that exists: https://datasets.gurasees.com/browse.md