Skip to content
Chinese robotics — Robot learning research·· 10 days agoSignalEditorial score88

OpenWAM: An Open Framework for Composable World-Action Models

李飞飞团队造了个世界动作模型:换个底座,机器人成功率 ...

Summary

This paper presents OpenWAM, an open framework for world-action models (WAM) that aims to standardize the evaluation of different WAM designs. The framework includes a three-stage training process, a shared MoT architecture, and four configurable interaction modes. It introduces modular components like IDM and FDM, trained on a large-scale 'counterfactual' dataset, leading to improved task success rates in both simulation and real-world robotic tasks.

Source: Chinese robotics — Robot learning research · Read original article ↗

English translation unavailable. Choose the original article to read it.

What the source reports

Publisher-reported claims, with original evidence. These results have not been independently verified by RoboSignal.

Reported numbers

  • training hours

    ≈14,600 hours

    View original evidence
    名义时长约 1.46 万小时
    Open source S11
  • training days

    14

    View original evidence
    训练了 14 天
    Open source S11
  • number of segments

    32,000

    View original evidence
    共得到 32000 个片段
    Open source S14
  • Reported success rate

    92.1%

    View original evidence
    VTA 和 Joint 平均成功率分别为 92.1% 和 91.9%
    Open source S18
  • paper: not_reported
  • code: not_reported
  • weights: not_reported
  • dataset: not_reported

What remains unknown

Not established in the collected evidence: Environment, Control, Data origin.

Reported performance applies to the described task. It does not establish general autonomy or deployment readiness.

Source excerpts and review record

Automatically extracted; no manual editorial approval recorded.

同一副骨架,四种「先想还是先动」 OpenWAM 从阿里开源的视频模型 Wan2.2-5B 出发,先在约 334 万条机器人与人类交互视频上继续预训练,名义时长约 1.46 万小时,全程不用动作标签,在 32 块 B200 上训练了 14 天。

Open source S11

为此团队构建了 LIBERO-Long-CF 数据集 :恢复示范中的仿真器状态,执行被改动过的动作,比如停止、反向、加噪声、改变夹爪开合时机等,共得到 32000 个片段、约 410 万条控制记录,是原始示范的 29.7 倍,其中 72.3% 的片段改变了物体的摆放状态。

Open source S14

实验:底座很能打,翻译器能搬家 在 LIBERO 四个子集上,四种交互程序的成功率都很高,VTA 平均达 98.6%,略高于论文引用的 LingBot-VA(98.5%)和 π0.5(96.9%)等已报告结果。

Open source S15

真机上,团队用两台 Franka FR3 机械臂测试了烤面包、还原 2×2 魔方最后一层和按颜色分拣杯子,VTA 和 Joint 平均成功率分别为 92.1% 和 91.9%。

Open source S18

视频链接:https://mp.weixin.qq.com/s/dI7-LFSWJsGak7e1PbTiZg 消融实验显示了底座的分量:其他条件不变,用原版 Wan2.2 初始化时 VTA 在 LIBERO-Long 上只有 68.4%, 换成机器人视频预训练的因果底座后升至 97.8%,提升 29.4 个百分点 。

Open source S19

从同一状态出发执行 16 种不同动作,让模型判断预测画面对应哪个真实结果,随机猜测约为 6%,只用示范训练的 FDM 为 21.1%,加入反事实数据后升至 71.3%,模型终于能分清「这样推」和「那样推」的区别。

Open source S22

Source:Chinese robotics — Robot learning research · 163.com

Timezone · UTC

Article dates follow your selected timezone. Briefing editions use Hong Kong time (UTC+8).