538 Hours of 'Extremely Messy' Human Data, Real Robot Takes Less Than an Hour: Hong Kong University Teaches Robots to Unpack Packages, Use Hot Glue Guns, and Make Cold Drinks
The MMLab team at the University of Hong Kong proposes the EgoWild2Dex method, which uses uncurated real human first-person operation data to train robots, enabling complex dual-arm dexterous tasks such as unpacking packages, using hot glue guns to fix figurines, and making cold drinks, with an average success rate of 96.7%. The method transfers natural human operation data to robotic execution space through GeoFormer perspective alignment and progressive training.