Technical glossary

Use the same words for the same data

Concise definitions for the model, collection, labeling, release, and evaluation concepts behind action trajectories.

Synthetic schema sampleObservation → action → next state
01
00.000sObservergb.player_view
02
00.050sActmove.forward + camera.delta
03
00.100sTransitionpose.x +0.84 m
04
00.150sOutcomeprogress 0.31 → 0.36

The values are synthetic and illustrate the public specification. They are not measurements from a commercial dataset.

W

World model

A learned representation of how an environment changes over time. It can predict future observations or latent states and support planning through simulated rollouts.

A

Action-conditioned world model

A world model that predicts future state or observations using an action, action sequence, or policy command as an explicit condition.

W

World action model

An emerging term for a model that jointly represents environment dynamics and action, often predicting or generating visual futures together with control sequences.

T

Trajectory

An ordered sequence of observations, actions, states, and optional rewards or outcomes belonging to one agent or episode.

E

Episode

A bounded attempt or interaction sequence with a defined beginning, context, and terminal condition.

O

Observation

Information available to an agent or model at a point in time, such as pixels, audio, depth, language, or sensor measurements.

A

Action

A control input or decision intended to influence the environment, recorded at a defined semantic level and time.

S

State

A representation of environment variables sufficient for a task or transition model, which may be measured, privileged, estimated, or latent.

T

Transition

A change from one state or observation to another, often represented as current context, action, next state, and outcome.

R

Rollout

A sequence generated by interacting with an environment or by repeatedly applying a model to imagine future states under actions.

T

Telemetry

Structured measurements emitted by a game, simulator, robot, or capture system, including state variables, events, timing, and system status.

T

Timebase

The clock and timestamp convention used to align streams within an episode or dataset.

D

Dataset provenance

The traceable history of where data came from, who collected or transformed it, which tools were used, and how a released file relates to its source.

O

Outcome

A result associated with a transition or episode, such as progress, reward, success, failure, event occurrence, or terminal condition.