OpenWAM: An Open Framework for Composable World-Action Models
李飞飞团队造了个世界动作模型:换个底座,机器人成功率 ...
This paper presents OpenWAM, an open framework for world-action models (WAM) that aims to standardize the evaluation of different WAM designs. The framework includes a three-stage training process, a shared MoT architecture, and four configurable interaction modes. It introduces modular components like IDM and FDM, trained on a large-scale 'counterfactual' dataset, leading to improved task success rates in both simulation and real-world robotic tasks.
Source: Chinese robotics — Robot learning research · Read original article ↗
English translation unavailable. Choose the original article to read it.
What the source reports
Publisher-reported claims, with original evidence. These results have not been independently verified by RoboSignal.
Reported numbers
training hours
≈14,600 hours
training days
14
number of segments
32,000
Reported success rate
92.1%
- paper: not_reported
- code: not_reported
- weights: not_reported
- dataset: not_reported
What remains unknown
Not established in the collected evidence: Environment, Control, Data origin.
Reported performance applies to the described task. It does not establish general autonomy or deployment readiness.
Source excerpts and review record
Automatically extracted; no manual editorial approval recorded.
同一副骨架,四种「先想还是先动」 OpenWAM 从阿里开源的视频模型 Wan2.2-5B 出发,先在约 334 万条机器人与人类交互视频上继续预训练,名义时长约 1.46 万小时,全程不用动作标签,在 32 块 B200 上训练了 14 天。
Open source S11
为此团队构建了 LIBERO-Long-CF 数据集 :恢复示范中的仿真器状态,执行被改动过的动作,比如停止、反向、加噪声、改变夹爪开合时机等,共得到 32000 个片段、约 410 万条控制记录,是原始示范的 29.7 倍,其中 72.3% 的片段改变了物体的摆放状态。
Open source S14
实验:底座很能打,翻译器能搬家 在 LIBERO 四个子集上,四种交互程序的成功率都很高,VTA 平均达 98.6%,略高于论文引用的 LingBot-VA(98.5%)和 π0.5(96.9%)等已报告结果。
Open source S15
真机上,团队用两台 Franka FR3 机械臂测试了烤面包、还原 2×2 魔方最后一层和按颜色分拣杯子,VTA 和 Joint 平均成功率分别为 92.1% 和 91.9%。
Open source S18
视频链接:https://mp.weixin.qq.com/s/dI7-LFSWJsGak7e1PbTiZg 消融实验显示了底座的分量:其他条件不变,用原版 Wan2.2 初始化时 VTA 在 LIBERO-Long 上只有 68.4%, 换成机器人视频预训练的因果底座后升至 97.8%,提升 29.4 个百分点 。
Open source S19
从同一状态出发执行 16 种不同动作,让模型判断预测画面对应哪个真实结果,随机猜测约为 6%,只用示范训练的 FDM 为 21.1%,加入反事实数据后升至 71.3%,模型终于能分清「这样推」和「那样推」的区别。
Open source S22
Source:Chinese robotics — Robot learning research · 163.com