Skip to content
Chinese robotics — Research news discovery·· 1 days agoSignalEditorial score88

RAX: A Framework for Autonomous Robot Exploration and Skill Acquisition

清华姚班、哈佛学霸,让机器人自己写代码、练技能,终于不用人手把手带了

Summary

Researchers from Harvard, NVIDIA, UC Berkeley, MIT, and Stanford introduce RAX, an open-source framework that allows robot agents to autonomously explore and learn by converting effective interactions into executable code. RAX enables robots to perform complex tasks like opening an air fryer, using multi-modal perception, planning, and continuous learning without human intervention. The framework demonstrates strong performance across multiple simulation benchmarks, with an average improvement of 37.4% over existing baselines.

Editorial context

The RAX framework enables robot agents to autonomously explore and learn through online experience, converting effective interactions into executable code. This approach reduces reliance on human demonstration data and allows for scalable generalization across diverse robot platforms and tasks.

Source: Chinese robotics — Research news discovery · Read original article ↗

English translation unavailable. Choose the original article to read it.

What the source reports

Publisher-reported claims, with original evidence. These results have not been independently verified by RoboSignal.

Reported numbers

  • time spent

    44 minutes

    View original evidence
    ▲《Scaling Online Exploration for Robot Agents》 比如,在机器人执行开空气炸锅任务时,智能体一开始要边看深度相机,边写分析脚本,边试动作,花了44分钟,写了23个分析脚本才完成第一次抓取。
    Open source S6
  • number of analysis scripts

    23

    View original evidence
    ▲《Scaling Online Exploration for Robot Agents》 比如,在机器人执行开空气炸锅任务时,智能体一开始要边看深度相机,边写分析脚本,边试动作,花了44分钟,写了23个分析脚本才完成第一次抓取。
    Open source S6
  • paper: not_reported
  • code: not_reported
  • weights: not_reported
  • dataset: not_reported
Source excerpts and review record

Automatically extracted; no manual editorial approval recorded.

▲《Scaling Online Exploration for Robot Agents》 比如,在机器人执行开空气炸锅任务时,智能体一开始要边看深度相机,边写分析脚本,边试动作,花了44分钟,写了23个分析脚本才完成第一次抓取。

Open source S6

在仿真实验中,RAX的平均表现比表现最好的基线模型高出 37.4%。

Open source S10

研究团队提出一个新的思路, 让智能体直接为机器人编写程序, 这样,整个过程不需要人工设计 动作原语 ( action primitives)。

Open source S16

在机器人开空气炸锅任务中,智能体打开空气炸锅抽屉,将一根香蕉放入炸篮,再关闭抽屉。

Open source S22

智能体首先将RGB-D相机采集的观测数据转换为点云,并统一到机器人基座坐标系中。

Open source S23

一、智能体直接上手写程序,让机器人学会自主操作空气炸锅 VLA模型和WAM模型,分别用大规模遥操作数据,对预训练的VLM和视频生成模型进行微调。

Open source S12

实验结果表明,随着探索规模扩大,机器人在未见过的环境中,其泛化能力得到持续提升。

Open source S9

Source:Chinese robotics — Research news discovery · news.qq.com

Timezone · UTC

Article dates follow your selected timezone. Briefing editions use Hong Kong time (UTC+8).