Apple Research Team Discloses Progress on Humanoid Robot 'Brain' System

Apple research team discloses progress on robot “brain” Average success rate for single-task tests is 91%

Cailian Press, November 7: The Apple Research team disclosed research progress on the robot “brain.” On November 4 local time, the Apple Research team submitted the paper “Perceptive Humanoid Motion from Simulation” to the preprint platform arXiv, disclosing the humanoid robot autonomous control system HALO. The research team also released data generation, model training, and deployment code, covering aspects such as motion generation, motion tracking, task orchestration, as well as simulation and real robot operation. According to the paper, the research team conducted 360 single-task tests in 6 real environments that were not pre-scanned or mapped, with an average success rate of 91%. Additionally, in one real environment, 10 tests were conducted for 3 types of combined tasks, with an average success rate of 70%. Among them, the combination of “bend down to pass through an obstacle—walk toward the target—push a box” had a success rate of 50%. It should be noted that the simulation-generated data was not completely free from human participation. The team stated that new physical tasks still require manually written prompts and designed motion keyframes, and some motions also used human videos or motion capture materials. The research team also pointed out that currently, the robot mainly relies on visual perception and finds it difficult to directly perceive contact situations; when objects leave the camera's field of view or are obstructed, the performance of tasks involving many contacts will decline. Adding tactile perception is one of the subsequent directions for improvement. (The Paper News)