Robot evals are unsolved, I am glad someone is trying to change that and this is a fantastic team
Robot evals are unsolved, I am glad someone is trying to change that and this is a fantastic team
Source: Chris Paxton — X Robotics · Read original article ↗
Article text · Original source · English
Robot evals are unsolved, I am glad someone is trying to change that and this is a fantastic team
What the source reports
Publisher-reported claims, with original evidence. These results have not been independently verified by RoboSignal.
- paper: not_reported
- code: not_reported
- weights: not_reported
- dataset: not_reported
What remains unknown
Dataset licensing and commercial-use rights are not established here.
Source excerpts and review record
Automatically extracted; no manual editorial approval recorded.
- 100+ robots (@UnitreeRobotics G1s, @LeRobotHF SO-101s, YAMs, Franka and more)
Open source S5
- 140+ in-the-wild scenes
Open source S6
- 10,000 FREE eval hrs
Open source S8
Implications for data suppliers
RoboSignal interpretation and collection questions, not statements of buyer demand.
- Confirm the required data type and collection setting with the buyer; this source does not establish a complete collection specification.
- Validate demand and acceptance criteria with a buyer before scaling. Publication, popularity and a research result do not establish a purchase commitment.
Introducing RoboColosseum An open robot eval initiative by @huggingface @BitRobotNetwork @eaic_sg @DJiafei Access: - 100+ robots (@UnitreeRobotics G1s, @LeRobotHF SO-101s, YAMs, Franka and more) - 140+ in-the-wild scenes - Open rollout data - 10,000 FREE eval hrs Thread ↓View the quoted post on X
Source：Chris Paxton · x.com