Dataset catalog

Commercial programs and public references stay separate

Commission data against a training target, or inspect source-linked research releases without confusing listing with ownership.

Synthetic schema sampleObservation → action → next state
01
00.000sObservergb.player_view
02
00.050sActmove.forward + camera.delta
03
00.100sTransitionpose.x +0.84 m
04
00.150sOutcomeprogress 0.31 → 0.36

The values are synthetic and illustrate the public specification. They are not measurements from a commercial dataset.

Commercial data programs

Build against the model contract.

ActionTrajectories scopes first-party and licensed collection around the environment, action surface, state, outcomes, coverage, rights, and delivery interface your training program actually needs.

No commercial inventory is represented as immediately available until its release record and rights review are complete.

Send a project brief

Open research references

Independently maintained records for comparison and discovery. Access, license, and use remain with each original source.

Open reference2026-07-24

MineRL 2019

Human Minecraft demonstrations with recorded video, actions, rewards, and simulator-aligned state for imitation and reinforcement learning research.

Creator
MineRL Team
Scale
60M+ annotated state-action pairs reported in the paper
License
MIT License
Commercial use
Rights review required
Review dataset record
Open reference2026-07-24

Rocket Science

Synchronized four-player Rocket League video, keyboard actions, game events, and per-frame physics state used to train the MIRA multiplayer world model.

Creator
General Intuition and Kyutai, in collaboration with Epic Games
Scale
15,769 train matches and 62 test matches, approximately 29.2 TB
License
CC BY-NC-SA 4.0
Commercial use
Non-commercial
Review dataset record
Open reference2026-07-24

NitroGen

Per-frame gamepad action annotations for public gameplay videos, intended for behavior cloning and action-to-video world-model research.

Creator
NVIDIA Corporation
Scale
30K annotated videos and approximately 15B annotated frames
License
CC BY-NC 4.0
Commercial use
Non-commercial
Review dataset record

Bring us the training target.

We will map it to the observations, actions, state, outcomes, rights, and delivery evidence the dataset must contain.

Request access