NVIDIA Ominverse Robot Onboarding and Mission Control powered by Salesforce Agentforce

A full-stack system that connects digital twin simulations in NVIDIA Omniverse to real robots and AI agents via Salesforce and MuleSoft, enabling natural language control and onboarding of robot fleets.
Step 1: Upload FBX File

- Upload 3D model files (FBX) to Salesforce
- Links the file to a robot Asset record via ContentDocumentLink
- Skip option available

Step 2: Trigger Omniverse Scan

- Triggers NVIDIA Omniverse to scan the 3D environment
- Retrieves scan results (JSON with 575 USD objects and their coordinates)
- Displays scanned objects in a table with item IDs and XYZ positions

Step 3: Robot Onboarding

- Robot Selection: Choose from 25+ robot types (Boston Dynamics Spot, Figure AI, Tesla Optimus, etc.) with quantities
- USD Object Selection: Checkboxes for scanned objects with custom naming
- Salesforce Record Creation:
- Robot Assets - for each selected robot with AccountId
- Object Assets - for each selected USD object
- ServiceResources - linked to Contact for Field Service scheduling
- Cases (Service Requests) - for robot deployment tracking
- Agentforce Agent Deployment: Creates an AI agent with:
- Instructions for robot navigation (goto commands with item IDs)
- Robot capabilities and types
- Full JSON payload of scanned objects