Interactive World Simulation with Cosmos for Physical AI
Overview
Researchers present a shared framework adapting the Cosmos world foundation model for real-time interactive simulation in Physical AI. By streaming visual observations in response to actions and scene controls, the system enables interaction with evolving virtual environments. It supports predicting visual consequences of actions and generating observations from physical state maintained by an external simulator. Demonstrations include camera navigation, robot manipulation, controllable video transfer, and multi-view autonomous vehicle simulation.
Generated from attributed reports · Updated 3 days ago
Event evidence and corrections
0 attributed source owners. Ownership does not establish independent confirmation. Quantities are reported separately and are never added together.
Environment: simulation
“arXiv:2611.06627v1 Announce Type: cross Abstract: We present a shared framework that adapts Cosmos world foundation models for real-time interactive world simulation in Physical AI. By streaming visual observations in response to actions and scene controls, the framework enables users and embodied agents to interact with evolving virtual environments. It supports both predicting the visual consequences of actions and”
Exact source · revision 1Source owner not reported
Report timeline
Follow attributed reports and material updates.
- arXiv Robotics — research abstractsSignalInteractive World Simulation with Cosmos for Physical AI
Researchers present a shared framework adapting the Cosmos world foundation model for real-time interactive simulation in Physical AI. By streaming visual observations in response to actions and scene controls, the system enables interaction with evolving virtual environments. It supports predicting visual consequences of actions and generating observations from physical state maintained by an external simulator. Demonstrations include camera navigation, robot manipulation, controllable video transfer, and multi-view autonomous vehicle simulation.
Event coverage history
Current attention 3·Peak within the comparable range 3（2026-11-07 01:00 UTC）·Change within the comparable range over 24 hours –
The trend compares participants observed continuously; its scope may be narrower than current attention totals. Hover or click to explore hourly observations, or use the left and right arrow keys.
Timezone · UTC
Article dates follow your selected timezone. Briefing editions use Hong Kong time (UTC+8).