RAX: A Framework for Autonomous Robot Exploration and Skill Acquisition
清华姚班、哈佛学霸,让机器人自己写代码、练技能,终于不用人手把手带了
Researchers from Harvard, NVIDIA, UC Berkeley, MIT, and Stanford introduce RAX, an open-source framework that allows robot agents to autonomously explore and learn by converting effective interactions into executable code. RAX enables robots to perform complex tasks like opening an air fryer, using multi-modal perception, planning, and continuous learning without human intervention. The framework demonstrates strong performance across multiple simulation benchmarks, with an average improvement of 37.4% over existing baselines.
The RAX framework enables robot agents to autonomously explore and learn through online experience, converting effective interactions into executable code. This approach reduces reliance on human demonstration data and allows for scalable generalization across diverse robot platforms and tasks.
Source: Chinese robotics — Research news discovery · Read original article ↗
English translation unavailable. Choose the original article to read it.
What the source reports
Publisher-reported claims, with original evidence. These results have not been independently verified by RoboSignal.
Reported numbers
time spent
44 minutes
View original evidence
▲《Scaling Online Exploration for Robot Agents》 比如,在机器人执行开空气炸锅任务时,智能体一开始要边看深度相机,边写分析脚本,边试动作,花了44分钟,写了23个分析脚本才完成第一次抓取。
Open source S6number of analysis scripts
23
View original evidence
▲《Scaling Online Exploration for Robot Agents》 比如,在机器人执行开空气炸锅任务时,智能体一开始要边看深度相机,边写分析脚本,边试动作,花了44分钟,写了23个分析脚本才完成第一次抓取。
Open source S6
- paper: not_reported
- code: not_reported
- weights: not_reported
- dataset: not_reported
Source excerpts and review record
Automatically extracted; no manual editorial approval recorded.
▲《Scaling Online Exploration for Robot Agents》 比如,在机器人执行开空气炸锅任务时,智能体一开始要边看深度相机,边写分析脚本,边试动作,花了44分钟,写了23个分析脚本才完成第一次抓取。
Open source S6
在仿真实验中,RAX的平均表现比表现最好的基线模型高出 37.4%。
Open source S10
研究团队提出一个新的思路, 让智能体直接为机器人编写程序, 这样,整个过程不需要人工设计 动作原语 ( action primitives)。
Open source S16
在机器人开空气炸锅任务中,智能体打开空气炸锅抽屉,将一根香蕉放入炸篮,再关闭抽屉。
Open source S22
智能体首先将RGB-D相机采集的观测数据转换为点云,并统一到机器人基座坐标系中。
Open source S23
一、智能体直接上手写程序,让机器人学会自主操作空气炸锅 VLA模型和WAM模型,分别用大规模遥操作数据,对预训练的VLM和视频生成模型进行微调。
Open source S12
实验结果表明,随着探索规模扩大,机器人在未见过的环境中,其泛化能力得到持续提升。
Open source S9
Source:Chinese robotics — Research news discovery · news.qq.com