GPT-6-Astra's Embodied Intelligence Put to the Test, Traditional Benchmarks Score Perfectly, Real Robots Hit Snags
This research paper evaluates GPT-6-Astra's embodied intelligence capabilities across 12 simulated benchmarks and 8 real-world robot platforms. While it achieves high scores in structured tasks like LIBERO-Long++ and SIMPLE, real-world execution reveals significant limitations, including safety issues, mechanical load constraints, and failure to handle complex, unstructured tasks. The study highlights the gap between simulation and physical deployment, and proposes improvements through better execution systems and task-specific adaptations.