Learning Robotic World Models with Semantic and Visual Feedback
Learning Robotic World Models with Semantic and Visual Feedback
This research presents RoboImagine, a framework designed to enhance robotic world models by combining semantic evaluation with visual consistency feedback. The system uses candidate-future comparisons under shared observations to promote trajectory diversity and constrain fine-grained errors. Evaluated on RT-1, BridgeV2, and RoboCasa, the method achieves measurable improvements in PSNR and LPIPS metrics compared to continued supervised fine-tuning, demonstrating gains in visual fidelity, task relevance, and long-horizon prediction capabilities.
The paper introduces RoboImagine, a framework for post-training autoregressive robotic world models that integrates semantic and visual feedback to improve prediction fidelity and task relevance across real-world and simulated manipulation tasks.
Source: arXiv Robotics — research abstracts · Read original article ↗
Loading article text…
What the source reports
Publisher-reported claims, with original evidence. These results have not been independently verified by RoboSignal.
Reported numbers
PSNR improvement
1.26
View original evidence
-1, BridgeV2, and RoboCasa cover real-world and simulated manipulation. On RT-1, under matched initialization, update counts, and evaluation protocols, RoboImagine improves PSNR by 1.26 dB and reduces LPIPS by 11.93% relative to continued supervised fine-tuning. Ablations show that diverse search improves prediction quality and that combined semantic and visual feedback yields higher external multimodal evaluation sc
Open source S5
- paper: not_reported
Source excerpts and review record
Automatically extracted; no manual editorial approval recorded.
-1, BridgeV2, and RoboCasa cover real-world and simulated manipulation. On RT-1, under matched initialization, update counts, and evaluation protocols, RoboImagine improves PSNR by 1.26 dB and reduces LPIPS by 11.93% relative to continued supervised fine-tuning. Ablations show that diverse search improves prediction quality and that combined semantic and visual feedback yields higher external multimodal evaluation sc
Open source S5
Source：arXiv Robotics — research abstracts · arxiv.org