Research & robot learning · SCENARIO ROADMAP

Collect demonstrations and train an imitation policy

Develop a traceable teleoperation, dataset, training and held-out evaluation workflow.

Reviewed October 26, 2026 · Editorial learning and project guidance. Professional means project depth, not an accredited qualification.

THE DESTINATION

What you will produce

A complete demonstration-to-evaluation report and reproducible artifacts. State where the learned policy works and where it needs intervention.

Before you begin

Starting knowledge

  • Comfort with Python, data arrays and supervised-learning concepts.
  • Understand the robot and camera calibration procedure.

Equipment & environment

Use an offline dataset or simulator first. Hardware demonstrations need a supervised recording space and documented reset procedure.

No fixed completion time: use the evidence gates below to decide when to advance. Resource links open the botstest directory entry; check its publisher documentation for the exact version and configuration.

01

Beginner

Inspect the data before training

Understand how observations, actions and episodes are represented.

Learn in this order

  1. Episode boundaries, timestamps and units
  2. Action representation and embodiment
  3. Dataset provenance and permitted use

Put it into practice

  1. Load a small demonstration dataset and inspect frames and actions.
  2. Write a schema note and identify missing or misaligned observations.
Produce this

A dataset inspection notebook and schema/permission note.

Ready for the next step when…

Resources for this stage

LeRobot →

Follow robot-data recording, dataset, policy and evaluation workflows for supported hardware and software.

BridgeData V2 →

Inspect a manipulation dataset and its collection conditions before designing training and evaluation splits.

Open X-Embodiment →

Examine multi-embodiment demonstration data, metadata, licenses and action conventions.

02

Intermediate

Record and train a bounded task

Build a reliable collection-to-training loop for one task.

Learn in this order

  1. Teleoperation calibration and operator consistency
  2. Held-out episodes and object leakage
  3. Baseline training configuration and checkpoint selection

Put it into practice

  1. Collect or curate a small fixed-task dataset and train a supported baseline.
  2. Compare two data-quality conditions using the same evaluation setup.
Produce this

A versioned dataset subset, baseline checkpoint and quality comparison.

Ready for the next step when…

Resources for this stage

SO-101 →

Explore a small teleoperation arm; confirm assembly, calibration and exact hardware revision support.

LeRobot →

Follow robot-data recording, dataset, policy and evaluation workflows for supported hardware and software.

robomimic →

Study offline demonstration-learning workflows and controlled policy comparisons.

03

Professional

Evaluate generalization and release the workflow

State where the learned policy works and where it needs intervention.

Learn in this order

  1. Shifted objects, scenes and start states
  2. Intervention accounting and recovery
  3. Cross-embodiment and hardware-transfer limitations

Put it into practice

  1. Run a predeclared evaluation matrix with repeatable resets.
  2. Release collection, processing and evaluation instructions with an honest failure report.
Produce this

A complete demonstration-to-evaluation report and reproducible artifacts.

Ready for the next step when…

Resources for this stage

ALOHA →

Study the original bimanual research design. Legacy commercial ALOHA hardware is end-of-life; verify parts and current alternatives.

Universal Manipulation Interface →

Examine handheld demonstration collection and how its calibration and action representation transfer to a target robot.

DROID →

Study a manipulation data-collection workflow and its embodiment and environment assumptions.

Common pitfalls

  • Assuming more demonstrations fix a broken timestamp convention.
  • Mixing evaluation scenes into training without disclosure.

Where to go next

Proceed to VLA comparison only when the simpler policy and data-quality baseline are understood.

Explore other research paths →

Related buying and solution guides