Real2Gym: Building Gyms from Videos, Bringing Skills to Robo
Overview
Source roundup from published reports. Claims below are attributed to their publishers, not independently verified. QbitAI — Robotics on WeChat: Token Usage Reduced by 74.9%: Real2Gym Turns Simulated Experience into Reusable Real-World Skills. Real2Gym is a research initiative proposed by institutions such as the Shanghai Artificial Intelligence Laboratory, aiming to construct interactive simulation environments through video, enabling robots to learn and tran…
Generated from attributed reports · Updated 3 hours ago
Event evidence and corrections
1 attributed source owners. Ownership does not establish independent confirmation. Quantities are reported separately and are never added together.
Environment: simulation
“执行轨迹随后导回Blender，与原视频对照，核查视觉对应和物理可行性。”
Exact source · revision 1qbitai
“在仿真里修正失败再回到真机 在Franka机械臂上，团队测试了方块入盘、挂杯、杯子放入微波炉并关门，以及盘子上架四项任务。”
Exact source · revision 1qbitai
“针对这一问题，来自 上海人工智能实验室、上海交通大学、浙江大学、中国科学技术大学、香港中文大学和香港大学 的研究团队提出 Real2Gym ：从人类或机器人视频构建可交互的仿真环境，让Agent在其中探索、积累技能，再将经验用于真实机器人。”
Exact source · revision 1qbitai
Reported quantity · Reported success rate: 87.5 percent · Basis not reported
“在这些环境中的Agent评估里，复用首轮经验后的第二次执行，平均成功率达到 87.5% ，GPT-6 Astra Direct Mode基线为70.8%；策略执行的 Token用量减少约74.9% 。”
Exact source · revision 1qbitai
Report timeline
Follow attributed reports and material updates.
- QbitAI — Robotics on WeChatSignalToken Usage Reduced by 74.9%: Real2Gym Turns Simulated Experience into Reusable Real-World Skills
Real2Gym is a research initiative proposed by institutions such as the Shanghai Artificial Intelligence Laboratory, aiming to construct interactive simulation environments through video, enabling robots to learn and transfer skills to the real world. This method combines geometric constraints, interaction keyframe correction, and physics engine validation, significantly improving task success rates and efficiency while reducing model invocation frequency.
Timezone · UTC
Article dates follow your selected timezone. Briefing editions use Hong Kong time (UTC+8).