Independent directory

Public world-model datasets, honestly labeled

Compare sources, schemas, scale, licenses, restrictions, and access paths without implying that public means commercially reusable.

Synthetic schema sampleObservation → action → next state
01
00.000sObservergb.player_view
02
00.050sActmove.forward + camera.delta
03
00.100sTransitionpose.x +0.84 m
04
00.150sOutcomeprogress 0.31 → 0.36

The values are synthetic and illustrate the public specification. They are not measurements from a commercial dataset.

What this directory is

A source-backed research aid maintained by ActionTrajectories. These releases remain the work of their named creators and providers.

What this directory is not

A mirror, resale catalog, legal opinion, or promise that an external dataset can be used for your commercial training program.

Open reference2026-07-24

MineRL 2019

Human Minecraft demonstrations with recorded video, actions, rewards, and simulator-aligned state for imitation and reinforcement learning research.

Creator
MineRL Team
Scale
60M+ annotated state-action pairs reported in the paper
License
MIT License
Commercial use
Rights review required
Review dataset record
Open reference2026-07-24

Rocket Science

Synchronized four-player Rocket League video, keyboard actions, game events, and per-frame physics state used to train the MIRA multiplayer world model.

Creator
General Intuition and Kyutai, in collaboration with Epic Games
Scale
15,769 train matches and 62 test matches, approximately 29.2 TB
License
CC BY-NC-SA 4.0
Commercial use
Non-commercial
Review dataset record
Open reference2026-07-24

NitroGen

Per-frame gamepad action annotations for public gameplay videos, intended for behavior cloning and action-to-video world-model research.

Creator
NVIDIA Corporation
Scale
30K annotated videos and approximately 15B annotated frames
License
CC BY-NC 4.0
Commercial use
Non-commercial
Review dataset record