Development & integration · SCENARIO ROADMAP

Integrate sensors and calibrate robot perception

Build a traceable sensing chain from raw observations to validated geometry and timing.

Reviewed October 26, 2026 · Editorial learning and project guidance. Professional means project depth, not an accredited qualification.

THE DESTINATION

What you will produce

A sensor acceptance suite and recalibration runbook. Detect when calibration or sensing assumptions no longer hold.

Before you begin

Starting knowledge

  • Basic geometry, units and programming.
  • Know the intended measurement and operating environment.

Equipment & environment

Start with recorded data. Use documented mounts and supervised equipment setup for physical captures.

No fixed completion time: use the evidence gates below to decide when to advance. Resource links open the botstest directory entry; check its publisher documentation for the exact version and configuration.

01

Beginner

Specify what must be observed

Choose sensing by measurement needs instead of a headline specification.

Learn in this order

  1. Range, field of view and scene limitations
  2. Camera intrinsics and sensor frames
  3. Bandwidth, interfaces and timestamp sources

Put it into practice

  1. Write an observation requirement for one scene or route.
  2. Inspect example sensor output and mark invalid or missing observations.
Produce this

A sensing requirements sheet and sample-data audit.

Ready for the next step when…

Resources for this stage

RealSense →

Compare depth sensing against range, scene, calibration and supported software requirements.

Orbbec →

Compare depth-camera options against the actual observation and integration requirements.

Ouster →

Study LiDAR integration, data interfaces and sensing conditions for the route or scene.

02

Intermediate

Calibrate geometry and align time

Check whether multiple observations can be compared in one frame.

Learn in this order

  1. Intrinsic/extrinsic calibration and mounting stability
  2. Clock alignment and transport delay
  3. Reference targets and residual inspection

Put it into practice

  1. Capture a repeatable target or reference scene.
  2. Compare aligned camera, depth or inertial observations and inspect residual errors.
Produce this

A calibration package and alignment validation report.

Ready for the next step when…

Resources for this stage

apriltag · AprilRobotics →

Explore fiducial detection and pose observations with known marker geometry and camera calibration.

Open3D →

Inspect point clouds and geometry-processing results before using them in a perception pipeline.

VectorNav →

Explore inertial measurement and state-estimation integration with explicit calibration and timing.

03

Professional

Operate a monitored perception chain

Detect when calibration or sensing assumptions no longer hold.

Learn in this order

  1. Drift, thermal changes and scene shift
  2. Data-quality monitoring and release records
  3. Recalibration triggers and component substitution

Put it into practice

  1. Define checks after a mount change, sensor replacement or software update.
  2. Replay normal and degraded recordings through the processing pipeline.
Produce this

A sensor acceptance suite and recalibration runbook.

Ready for the next step when…

Resources for this stage

Rerun →

Visualize spatial observations and compare them with model and trajectory outputs.

Foxglove →

Inspect recorded robot signals and build views that expose timing and system failures.

Luxonis OAK →

Investigate depth and edge-perception hardware in a recorded sensing experiment.

Common pitfalls

  • Confusing a product range specification with usable measurements in your scene.
  • Fixing a time-alignment issue by changing geometry.

Where to go next

Continue to perception research, navigation or inspection with the validated sensing chain.

Explore other build paths →