Interactive World Simulation with Cosmos for Physical AI
Interactive World Simulation with Cosmos for Physical AI
Researchers present a shared framework adapting the Cosmos world foundation model for real-time interactive simulation in Physical AI. By streaming visual observations in response to actions and scene controls, the system enables interaction with evolving virtual environments. It supports predicting visual consequences of actions and generating observations from physical state maintained by an external simulator. Demonstrations include camera navigation, robot manipulation, controllable video transfer, and multi-view autonomous vehicle simulation.
Source: arXiv Robotics — research abstracts · Read original article ↗
Loading article text…
What the source reports
Publisher-reported claims, with original evidence. These results have not been independently verified by RoboSignal.
- Environment
- SimulationOpen source S2
- paper: not_reported
Source excerpts and review record
Automatically extracted; no manual editorial approval recorded.
arXiv:2611.06627v1 Announce Type: cross Abstract: We present a shared framework that adapts Cosmos world foundation models for real-time interactive world simulation in Physical AI. By streaming visual observations in response to actions and scene controls, the framework enables users and embodied agents to interact with evolving virtual environments. It supports both predicting the visual consequences of actions and
Open source S2
https://github.com/nvidia/cosmos and https://huggingface.co/collections/nvidia/cosmos3-examples. The project website is available at https://research.nvidia.com/labs/cosmos-lab/cosmos-simulation.
Open source S4
Source：arXiv Robotics — research abstracts · arxiv.org