LeRobot 0.7: Interactive Rollouts for Mid-Run Steering
LeRobot 0.7 releases interactive rollouts allowing users to steer robot policies mid-run without reset. Features include /subtask switching, /vqa visual queries, /autosteer goal planning, and episode recording. Any VLM (transformers, vLLM, or inference providers) can serve as a planner. FineART-VLA, trained on 1,718 hours of data with 533,913 subtask labels from scale_AI and Hugging Face, verbalizes next subtasks before execution.
LeRobot 0.7 introduces interactive rollouts enabling mid-run steering via subtask switching, visual question answering, and autonomous planning with external VLMs or FineART-VLA, trained on 1,718 hours of data with 533,913 subtask labels.
Source: LeRobot — X · Read original article ↗
Article text · Original source · English
Talk to your robot while it works 🗣️🤖
New in LeRobot 0.7: interactive rollouts. Start a policy, then steer it mid-run, without a reset:
- /subtask: switch what it's doing
- /vqa: ask what it sees
- /autosteer: give it a goal and let a planner pick the steps
- record episodes while you steer
lerobot-rollout --interactive=true
No text-generating policy? Bring any VLM as the planner: transformers serve, vLLM or Inference Providers.
And FineART-VLA, trained on FineART from @scale_AI and Hugging Face (1,718 h, 533,913 subtask labels), says its next subtask out loud, then does it.
Docs in the comments 👇
Source：LeRobot · x.com