Rollout then Recycle: 3,718 Labelled Real-Robot Episodes from Benchmarking 7 Policies on 12 Tasks
Overview
This publication releases all 3,718 episodes from the ArmnetBench v0.1 evaluation, which includes 600 teleoperated demonstrations and 3,118 rollouts of seven imitation-learning and vision-language-action policies on 12 tabletop tasks recorded on low-cost SO-101 arms. The dataset contains 73% failure rollouts, with every episode labelled by an operator as successful, suboptimal, or failure. Each episode includes three camera views, joint states, and actions, and is available on the Hugging Face Hub in LeRobot v3.0 and a reward-model format.
Generated from attributed reports · Updated 1 hours ago
Event evidence and corrections
0 attributed source owners. Ownership does not establish independent confirmation. Quantities are reported separately and are never added together.
Control: teleoperated
“arXiv:2611.03168v1 Announce Type: new Abstract: We release all 3,718 episodes from the ArmnetBench v0.1 evaluation (arXiv:2607.24481), which contains 600 teleoperated demonstrations and 3,118 rollouts of seven imitation-learning and vision-language-action policies on 12 tabletop tasks, recorded on low-cost SO-101 arms; 73% of the rollouts are failures. Every policy for a task was trained or fine-tuned on the same 50”
Exact source · revision 1Source owner not reported
Reported quantity · episodes: 3718 other · Basis not reported
“arXiv:2611.03168v1 Announce Type: new Abstract: We release all 3,718 episodes from the ArmnetBench v0.1 evaluation (arXiv:2607.24481), which contains 600 teleoperated demonstrations and 3,118 rollouts of seven imitation-learning and vision-language-action policies on 12 tabletop tasks, recorded on low-cost SO-101 arms; 73% of the rollouts are failures. Every policy for a task was trained or fine-tuned on the same 50”
Exact source · revision 1Source owner not reported
Reported quantity · demonstrations: 600 other · Basis not reported
“arXiv:2611.03168v1 Announce Type: new Abstract: We release all 3,718 episodes from the ArmnetBench v0.1 evaluation (arXiv:2607.24481), which contains 600 teleoperated demonstrations and 3,118 rollouts of seven imitation-learning and vision-language-action policies on 12 tabletop tasks, recorded on low-cost SO-101 arms; 73% of the rollouts are failures. Every policy for a task was trained or fine-tuned on the same 50”
Exact source · revision 1Source owner not reported
Reported quantity · rollouts: 3118 other · Basis not reported
“arXiv:2611.03168v1 Announce Type: new Abstract: We release all 3,718 episodes from the ArmnetBench v0.1 evaluation (arXiv:2607.24481), which contains 600 teleoperated demonstrations and 3,118 rollouts of seven imitation-learning and vision-language-action policies on 12 tabletop tasks, recorded on low-cost SO-101 arms; 73% of the rollouts are failures. Every policy for a task was trained or fine-tuned on the same 50”
Exact source · revision 1Source owner not reported
Reported quantity · tasks: 12 other · Basis not reported
“arXiv:2611.03168v1 Announce Type: new Abstract: We release all 3,718 episodes from the ArmnetBench v0.1 evaluation (arXiv:2607.24481), which contains 600 teleoperated demonstrations and 3,118 rollouts of seven imitation-learning and vision-language-action policies on 12 tabletop tasks, recorded on low-cost SO-101 arms; 73% of the rollouts are failures. Every policy for a task was trained or fine-tuned on the same 50”
Exact source · revision 1Source owner not reported
Reported quantity · policies: 7 other · Basis not reported
“arXiv:2611.03168v1 Announce Type: new Abstract: We release all 3,718 episodes from the ArmnetBench v0.1 evaluation (arXiv:2607.24481), which contains 600 teleoperated demonstrations and 3,118 rollouts of seven imitation-learning and vision-language-action policies on 12 tabletop tasks, recorded on low-cost SO-101 arms; 73% of the rollouts are failures. Every policy for a task was trained or fine-tuned on the same 50”
Exact source · revision 1Source owner not reported
Reported quantity · camera views: 3 other · Basis not reported
“demonstrations and rolled out on the same cell, so the corpus contains many policies' failures on shared tasks. An operator labelled every rollout successful, suboptimal or failure. Each episode has three camera views, joint states and actions and is available on the Hugging Face Hub in LeRobot v3.0 and a reward-model format. This note documents how the episodes were collected and the limitations that could affect th”
Exact source · revision 1Source owner not reported
Reported quantity · robots: 1 other · Basis not reported
“arXiv:2611.03168v1 Announce Type: new Abstract: We release all 3,718 episodes from the ArmnetBench v0.1 evaluation (arXiv:2607.24481), which contains 600 teleoperated demonstrations and 3,118 rollouts of seven imitation-learning and vision-language-action policies on 12 tabletop tasks, recorded on low-cost SO-101 arms; 73% of the rollouts are failures. Every policy for a task was trained or fine-tuned on the same 50”
Exact source · revision 1Source owner not reported
Dataset · modalities: camera views · Differing source assertions
“demonstrations and rolled out on the same cell, so the corpus contains many policies' failures on shared tasks. An operator labelled every rollout successful, suboptimal or failure. Each episode has three camera views, joint states and actions and is available on the Hugging Face Hub in LeRobot v3.0 and a reward-model format. This note documents how the episodes were collected and the limitations that could affect th”
Exact source · revision 1Source owner not reported
Dataset · modalities: joint states · Differing source assertions
“demonstrations and rolled out on the same cell, so the corpus contains many policies' failures on shared tasks. An operator labelled every rollout successful, suboptimal or failure. Each episode has three camera views, joint states and actions and is available on the Hugging Face Hub in LeRobot v3.0 and a reward-model format. This note documents how the episodes were collected and the limitations that could affect th”
Exact source · revision 1Source owner not reported
Dataset · tasks: 12 tabletop tasks
“arXiv:2611.03168v1 Announce Type: new Abstract: We release all 3,718 episodes from the ArmnetBench v0.1 evaluation (arXiv:2607.24481), which contains 600 teleoperated demonstrations and 3,118 rollouts of seven imitation-learning and vision-language-action policies on 12 tabletop tasks, recorded on low-cost SO-101 arms; 73% of the rollouts are failures. Every policy for a task was trained or fine-tuned on the same 50”
Exact source · revision 1Source owner not reported
Dataset · embodiments: SO-101 arms
“arXiv:2611.03168v1 Announce Type: new Abstract: We release all 3,718 episodes from the ArmnetBench v0.1 evaluation (arXiv:2607.24481), which contains 600 teleoperated demonstrations and 3,118 rollouts of seven imitation-learning and vision-language-action policies on 12 tabletop tasks, recorded on low-cost SO-101 arms; 73% of the rollouts are failures. Every policy for a task was trained or fine-tuned on the same 50”
Exact source · revision 1Source owner not reported
Dataset · version: LeRobot v3.0
“demonstrations and rolled out on the same cell, so the corpus contains many policies' failures on shared tasks. An operator labelled every rollout successful, suboptimal or failure. Each episode has three camera views, joint states and actions and is available on the Hugging Face Hub in LeRobot v3.0 and a reward-model format. This note documents how the episodes were collected and the limitations that could affect th”
Exact source · revision 1Source owner not reported
Report timeline
Follow attributed reports and material updates.
- arXiv Robotics — research abstractsSignalRollout then Recycle: 3,718 Labelled Real-Robot Episodes from Benchmarking 7 Policies on 12 Tasks
This publication releases all 3,718 episodes from the ArmnetBench v0.1 evaluation, which includes 600 teleoperated demonstrations and 3,118 rollouts of seven imitation-learning and vision-language-action policies on 12 tabletop tasks recorded on low-cost SO-101 arms. The dataset contains 73% failure rollouts, with every episode labelled by an operator as successful, suboptimal, or failure. Each episode includes three camera views, joint states, and actions, and is available on the Hugging Face Hub in LeRobot v3.0 and a reward-model format.
Event coverage history
There is not enough continuous observation data to show a trend.
Timezone · UTC
Article dates follow your selected timezone. Briefing editions use Hong Kong time (UTC+8).