Learning from Fleet Experience: Collective Experience Learning Across 96 Robots
This research proposes Collective Experience Learning (CEL), a paradigm where deployed robots pool execution experience to update a shared policy. The method, implemented via Failure-Guided Experience Retrieval Fine-Tuning (FERT), uses failure contexts to retrieve successful trajectory segments for supervised updates without requiring new expert demonstrations. Evaluated across five real-world manipulation tasks on robots excluded from training, the approach achieves success rates between 93.3% and 99.2%. Specifically, on multi-stage phone packaging, using a fleet of 96 robots improved success rates from 79.2% to 98.3%, validating CEL as a scalable method for improving robot policy reliability through deployment-generated experience.