MDF++: Visuo-Tactile World Action Model with End-to-end Representation Learning
Overview
This research introduces MDF++, a visuo-tactile world-action model designed to learn physically grounded, control-relevant representations for robot manipulation. Unlike existing world-action models that rely on frozen pretrained encoders, MDF++ employs an end-to-end learning strategy with a diffusion backbone and a multi-task learning approach to leverage cross-modal correlations. The authors evaluate the model on contact-rich tasks such as real-world bolt screwing and nut mating, reporting performance improvements of up to 50% compared to models built on frozen representations.
Generated from attributed reports · Updated 2 days ago
Event evidence and corrections
0 attributed source owners. Ownership does not establish independent confirmation. Quantities are reported separately and are never added together.
Reported quantity · percent improvement over frozen pretrained WAMs: 50 other · Basis not reported
“correlations to learn task-relevant representations. We evaluate MDF++ on a suite of contact-rich manipulation tasks, including realworld bolt screwing and nut mating, and show that it outperforms WAMs built on frozen pretrained representations by up to 50%. Additional videos are available on our website: jointmdf.github.io.”
Exact source · revision 1Source owner not reported
Report timeline
Follow attributed reports and material updates.
- arXiv Robotics — research abstractsSignalMDF++: Visuo-Tactile World Action Model with End-to-end Representation Learning
This research introduces MDF++, a visuo-tactile world-action model designed to learn physically grounded, control-relevant representations for robot manipulation. Unlike existing world-action models that rely on frozen pretrained encoders, MDF++ employs an end-to-end learning strategy with a diffusion backbone and a multi-task learning approach to leverage cross-modal correlations. The authors evaluate the model on contact-rich tasks such as real-world bolt screwing and nut mating, reporting performance improvements of up to 50% compared to models built on frozen representations.
Event coverage history
Current attention 3·Peak within the comparable range 4（2026-11-10 11:00 UTC）·Change within the comparable range over 24 hours –
The trend compares participants observed continuously; its scope may be narrower than current attention totals. Hover or click to explore hourly observations, or use the left and right arrow keys.
Timezone · UTC
Article dates follow your selected timezone. Briefing editions use Hong Kong time (UTC+8).