Perception & geometry

Open source

Autonomous Perception

Open source

BiFold research code for language-guided bimanual cloth folding.

Open source

sensor calibration tools for autonomous driving and robotics

Open source

Extrinsic Calibration of a Camera and 2d Laser

Research

Cornell House Agent Learning Environment and associated resources.

Open source

ROS tools and Raspberry Pi images for PX4-powered drones.

Research

Constraint-aware imitation-learning research for autonomous racing.

Open source

Robotics with GPU computing

Research

🍀 DexTrack: Towards Generalizable Neural Tracking Control for Dexterous Manipulation from Human References

Research

Official code of "EmbodiedSplat: Online Feed-Forward Semantic 3DGS for Open-Vocabulary 3D Scene Understanding"

Open source

Example connecting an Isaac GR00T policy to a simulated Franka Panda in MuJoCo.

Open source

NVIDIA Halos Outside-In Safety Blueprint extends robot perception beyond on-board sensors by using external infrastructure cameras and AI agents to dynamically control robot behavior and perform…

Open source

Hobot StereoNet is a high-performance, deep learning-based stereo depth estimation algorithm developed by D-Robotics. It processes stereo image pairs to generate accurate depth maps in real-time…

Open source

A simulation environment for reinforcement learning and robotics research.

Research

Learning Soccer Skills for Humanoid Robots: A Progressive Perception-Action Framework

Open source

NVIDIA-accelerated Apriltag detection and pose estimation.

Open source

Rigid transformations and Lie groups for JAX.

Open source

Guides and code for deep-learning inference on NVIDIA Jetson with TensorRT.

Research

An integrated humanoid control, planning and perception system. Developed by MIT and the University of Edinburgh for the Boston Dynamics Atlas and the NASA Valkyrie humanoid robots

Open source

A Fully Open-source and Compact Aerial Robot with Omnidirectional Visual Perception

Open source

OpenEyes is an open-source robot vision framework for edge devices

Open source

Research code for open-vocabulary affordance detection in 3D point clouds.

Research

Official implementation of the paper: "OptiGeo: Efficient Monocular Geometry for Embodied Perception in Optically Challenging Scenes"

Open source

A specification for permissioned egocentric teaching of personal robots.