GoalDex: Learning Image-Goal-Conditioned Policies for Dexterous In-Hand Manipulation
GoalDex: Learning Image-Goal-Conditioned Policies for Dexterous In-Hand Manipulation
This research introduces GoalDex, an end-to-end visuomotor framework for dexterous in-hand manipulation that operates on RGB observations and proprioception without intermediate pose estimation. The approach jointly learns visual representations and control policies through behavior distillation from privileged state teachers and auxiliary reconstruction objectives. It enables image-goal-conditioned reorientation, allowing desired object configurations to be specified directly through images. Evaluated across diverse object geometries in simulation, the method consistently outperforms pose-based methods and policies built on pretrained visual encoders. The authors also demonstrate direct sim-to-real transfer of a single image-goal-conditioned policy across five real-world objects, achieving accurate dexterous reorientation without explicit pose estimation.
The authors present an end-to-end visuomotor framework that learns image-goal-conditioned policies for dexterous in-hand manipulation without explicit pose estimation, demonstrating sim-to-real transfer across five real-world objects.
Source: arXiv Robotics — research abstracts · Read original article ↗
Loading article text…
What the source reports
Publisher-reported claims, with original evidence. These results have not been independently verified by RoboSignal.
- code: Reported pending Open source S5
- weights: not_reported
- dataset: not_reported
- paper: not_reported
- code: not_reported
Source excerpts and review record
Automatically extracted; no manual editorial approval recorded.
dexterous reorientation can be achieved without explicit pose estimation. For videos and code release, please refer to the project website: https://rffr.leggedrobotics.com/works/goaldex/
Open source S5
Source：arXiv Robotics — research abstracts · arxiv.org