NVIDIA Isaac Perceptor
NVIDIA Isaac™ Perceptor, built on Isaac ROS, is a collection of NVIDIA® CUDA®-accelerated libraries, AI models, and reference workflows for the development of autonomous mobile robots (AMRs). These robots are designed to perceive, localize, and operate in unstructured environments like warehouses, factories, and outdoor settings.
You can integrate one or all of Isaac Perceptor’s technologies into your own AMR software stack to achieve advanced AI for perception capabilities or evaluate it with the NVIDIA Nova Orin™ Developer Kit.
How NVIDIA Isaac Perceptor Works
Today’s unstructured environments pose unique predictability challenges for AMRs, including task-specific complexities like load pickup and dropoff. NVIDIA-accelerated libraries and AI models help you overcome these complexities by enabling advanced 3D perception capabilities that ensure optimal performance and modularity for your specific needs.
Isaac Perceptor is a collection of these libraries and models purpose-built for developers of autonomous forklifts and industrial mobile robots, powering robust visual odometry and 3D surround vision for obstacle detection and occupancy mapping.
Quick Start Guide
Begin with an introduction to the basics of Isaac Perceptor.
Beginner Workflows
This guide outlines Isaac Perceptor's key components and provides a tested architecture compatible with NVIDIA Jetson Orin.
What’s New
See what’s available for Isaac Perceptor to improve an autonomous robot’s environmental awareness.
Real-World Use Cases
Discover how Isaac Perceptor is revolutionizing the next generation of mobile robots.
Key Features
Fully Optimized for Mobile Robots
Drive innovation in autonomous forklifts and industrial mobile robots with advanced visual odometry and 3D surround vision technology for obstacle detection and spatial awareness.
Scalable Sensor Architecture
Tap into the industry’s first scalable architecture for one to eight cameras with time synchronization across all the cameras and Inertial Measurement Units (IMUs).
Ready for Deployment
Take advantage of pre-integrated, extensively tested subgraphs for mobile robots to ensure seamless integration with existing software stacks and robots.
Open Ecosystem
Built on ROS
NVIDIA Isaac Perceptor is built on the open-source ROS 2 (Robot Operating System) software framework. This lets the millions of developers in the ROS community easily take advantage of NVIDIA-accelerated libraries and AI models to accelerate their AI robot development and deployment workflows.
Learn More About Isaac ROS
ROS is a trademark of Open Robotics
Real-Time 3D Occupancy Grid
Get results 100X faster than with CPU-centric methods using nvblox. This NVIDIA® CUDA®-accelerated 3D reconstruction library can identify obstacles up to 5 meters away to provide a 2D costmap.
Accelerated Stereo Visual Odometry and SLAM
Seamlessly navigate environments with sparse visual features or repetitive patterns by fusing input from multiple viewpoints using NVIDIA cuVSLAM.
AI-Based Depth Perception
Take advantage of stereo DNN for dense, detailed, robust complexity. The stereo disparity is calculated from a time-synchronized image pair sourced from a stereo camera and used to produce a depth image or point cloud for a scene.
Get Started With Isaac Perceptor
Download Code
To get started with the latest version of Isaac Perceptor, download the launch files from Github.
Build With Nova Orin and Our Partner Developer Kits
The NVIDIA Nova Orin Developer Kit is a powerful compute and sensor platform designed to help robot OEMs and software companies accelerate the development and deployment of AMRs. You can benefit from the multi-camera support feature that integrates RGB cameras from partners like Orbbec and LIPS.
Starter Kits
Start developing your robotics applications with Isaac Perceptor by accessing tutorials, forums, release notes, and comprehensive documentation.
Quickstart Guide: Isaac Perceptor on Nova Orin Developer Kit
Get started with Isaac Perceptor on your Nova Orin Developer Kit with the following quickstart guides.
Beginner Workflows: Run and Evaluate Isaac Perceptor
Use the following tutorials to run and evaluate Isaac Perceptor.
Use Case: Wheel.me Self-Driving Robots Use RGo and the NVIDIA Isaac Platform
Wheel.me stands out with its ambitious mission: to transform anything that moves into an autonomous mobile robot (AMR). Learn how the company, in collaboration with NVIDIA and RGo Robotics, is reshaping the landscape of mobile robotics.
Test and Validate in Simulation
Virtually train, test, and validate robotics systems using NVIDIA Isaac Sim and NVIDIA Isaac Lab.
Isaac Perceptor Learning Library
Ecosystem
Our industry partners and collaborators are integrating NVIDIA Isaac Perceptor and accelerated computing into their platforms and solutions.
.svg){kind=logo}
