Technical Directions
Robotics coverage relating to sim-to-real.
308 selected reportsLast 30 days 269 recordsAll coverage 1,317 records
Dexterity introduces 'Transactable World Models' as a foundational component for Physical AI, emphasizing interpretability, physics integration, and real-time consistency. The approach treats world models as operators rather than data stores, enabling multi-agent coordination and robust manipulation in complex environments. This contrasts with traditional world models that focus on data compression and replay, lacking causal reasoning and physical grounding.
Dexterity, a leader in physical AI and robotics, has partnered with ASRock Rack to develop custom AI supercomputing systems for its Mech industrial superhumanoid robot. These edge AI servers provide real-time processing for warehouse automation tasks, enhancing autonomy and performance without cloud dependency.
This hands-on tutorial walks through the process of collecting data, training policies, and deploying autonomous medical robotics workflows on real hardware using NVIDIA Isaac for Healthcare. It introduces the SO-ARM starter workflow, which enables developers to build and validate surgical assistant robots from simulation to deployment.
Hugging Face announces LeRobot v0.4.0, a major upgrade for open-source robotics with Dataset v3.0, new VLA models like PI0.5 and GR00T N1.5, and a plugin system for hardware integration. The release also adds support for LIBERO and Meta-World simulations, multi-GPU training, and a new Hugging Face Robot Learning Course.
Hugging Face introduces SmolVLA, a 450M parameter open-source Vision-Language-Action model for robotics, trained on community-shared datasets. It outperforms larger models in simulation and real-world tasks, supports asynchronous inference for faster response, and is designed for deployment on consumer hardware.
SmolVLA is a compact, efficient Vision-Language-Action (VLA) model designed for affordable robotics, trainable on a single GPU and deployable on consumer hardware. It matches the performance of larger VLAs through community-driven data, with a reference implementation and training instructions provided.
Sanctuary AI has demonstrated industry-leading sim-to-real transfer of dexterous manipulation policies using their high-degree-of-freedom hydraulic hands. The company leverages NVIDIA Isaac Lab, an open-source framework for robot learning, to simulate dexterity-focused training environments. This approach enables efficient training of autonomous robots, with the ability to train thousands of hands simultaneously and accelerate the learning process through online reinforcement learning.
NIST is launching the Agile Robotics for Industrial Automation Competition (ARIA) to improve robot agility in manufacturing. The competition, a joint effort with the IEEE Conference on Automation Science and Engineering, will focus on tasks such as failure recovery, automated planning, and plug-and-play robot integration. The goal is to reduce programming costs and increase adaptability for small and medium manufacturers.
Article dates follow your selected timezone. Briefing editions use Hong Kong time (UTC+8).