Technical Directions
Robotics coverage relating to world models.
20 selected reportsLast 30 days 10 recordsAll coverage 82 records
Agnes AI officially opens sources its agent execution infrastructure Agnes Harness (AGH) and device interaction protocol MHS (Model Hardware Standard), providing developers with a unified toolchain that supports the continuous execution of AI Agents in real-world tasks and physical devices.
The Yuance Future team demonstrated their robot's performance in complex tasks, including reaching high places to retrieve objects, picking up bottles from low positions, clearing tables, and operating dishwashers. The article introduced their 'Whole-Body Intelligence' (Whole-Body Intelligence, WBI) technology approach, emphasizing the integration of body coordination and task execution. By collecting human motion data, real-machine training, and cross-body validation, the robot gradually adapts to various challenges in real-world scenarios.
The article describes how the WR1 robot, developed by West Lake Robotics, successfully performs complex household tasks such as folding clothes and managing multi-scene operations. It highlights the use of a dual pre-training system, world models, and a general-purpose action execution model to achieve seamless coordination between perception, planning, and execution. The robot's ability to handle flexible objects and maintain task continuity across different environments is emphasized as a significant breakthrough in embodied AI.
Robotic Systems Lab@leggedroboticsSignalEditorial score6363
What if one world model could control many different robots? 🤖🌍 That's QWM. In this 2 minutes video we show keypoints about QWM: learning across heterogeneous quadrupeds, and transferring zero-shot to unseen morphologies. No fine-tuning. No warm-up. No retraining. Let's talk it further at CoRL 🥳
Jiang Zheyuan, founder of Songyan Dynamics, discusses the company's strategic shift toward developing a 'robot brain' and its vision for the future of embodied AI. The article highlights the company's focus on reducing robot costs, improving reliability, and achieving scalable data collection for training intelligent systems. Jiang outlines the company's roadmap from L0 to L3 intelligence levels, emphasizing the importance of data diversity and real-world deployment.
The paper explores the challenges and opportunities in scaling Physical AI for robotics, focusing on the need for real-world data, the limitations of simulation, and the importance of a continuous data flywheel. It discusses the role of reinforcement learning, human demonstration learning, and Edge AI in enabling scalable robotic deployments. Qualcomm's capabilities in XR, edge computing, and AI infrastructure are highlighted as key enablers for this emerging field.
The IROS 2026 conference highlights a shift towards long-term tasks, failure recovery, and world modeling in robotics. The event showcases advancements in perception, planning, and control, with a focus on real-world applications and standardized testing. The integration of tactile and force feedback, along with data collection tools, reflects a growing emphasis on embodied intelligence and simulation-to-reality transitions.
The article analyzes China's leading position in the field of humanoid robot patents, noting that as of the first half of 2026, China holds 60.8% of relevant patents, significantly surpassing the United States and South Korea. The article examines the evolution of patent strategies, the trend of technological shift from hardware to software, and the progress made by Chinese companies in patent quality, application scenarios, and global layout. It also points out that patent quantity does not equate to comprehensive technological leadership, emphasizing the challenges of manufacturing costs and quality, as well as the dual role of patents in industrial competition.
Daimon Robotics, a physical AI company focused on tactile intelligence, showcased its full-stack physical AI capabilities at IROS 2026. The company presented its tactile infrastructure and advances in dexterous robotic manipulation, including the Daimon-TWM model, which enables real-time control and predictive decision-making through tactile feedback. The model was demonstrated in two live tasks: friendship bracelet stringing and canvas tote heat-transfer printing, showcasing its ability to adapt to changing contact conditions and force-sensitive operations.
Animesh Garg@animesh_gargSignalEditorial score8585Introducing FLUX 3 Action. An open weights 7B World Action Model that achieves first place on the RoboLab benchmark. It outperforms the previous best open model by 6.1 percentage points while using 56% fewer parameters and running up to 3.95x faster. FLUX 3 Action removes the usual trade-off between world action model performance and VLA speed: it still predicts video and actions together, but plans more than twice as far ahead and runs faster per second of robot motion than the strongest open VLA. Teams can fine-tune FLUX 3 Action on their own demonstrations to create policies for a particular robot and task. Together with @nvidia, we also integrated FLUX 3 Action natively into @huggingface's LeRobot, with fine-tuning recipes included and edge deployment on NVIDIA Jetson. Beyond robotics, we’re also seeing promising results training task-specific policies for acting in simulated environments like gaming, controlling a vehicle, computer use, and wherever else a model needs to understand a visual environment and then choose what to do next. FLUX 3 Action builds on the same image, video, and audio pretraining as FLUX 3, but uses a smaller architecture designed for practical deployment. In midtraining, we trained the model to predict actions and future frames together. We’re releasing the weights, code, fine-tuning recipe, benchmarks, and reproducible examples so researchers and developers can build on the model with their own robots, environments, and tasks (see below).
NVIDIA introduces Cosmos 3, an open-world model family for physical AI, combining vision reasoning, world generation, and action prediction. Available under the Linux Foundation’s OpenMDW 1.1 license, it enables post-training and adaptation for robotics, autonomous vehicles, and vision AI systems. The model ranks highly in benchmark evaluations and is part of NVIDIA’s broader physical AI stack.
FedEx and Dexterity have expanded their collaboration to deploy Dexterity's Foresight world model and Mech trailer loading systems at the FedEx Hagerstown Hub. This marks a significant scaling of physical AI in logistics, enabling production at a larger operational scale with a focus on safety, consistency, and performance.
NVIDIA introduces Cosmos-H-Dreams, a real-time, action-conditioned generative simulator for surgical robotics. It distills the capabilities of Cosmos-H-Surgical-Simulator into a causal, few-step student model, enabling interactive environments for policy evaluation and synthetic data generation. The system runs on a single NVIDIA RTX PRO 6000 GPU and supports integration with surgical platforms like Versius.
NVIDIA has released an open-source, GPU-accelerated Medical Physics Simulation framework as part of its Isaac for Healthcare platform. This tool enables developers to model anatomy-device interactions, generate complex scenarios, and train robot policies in simulation, significantly reducing development time and improving regulatory readiness.
NVIDIA and Hugging Face are releasing the NVIDIA Isaac GR00T 1.7 model and Isaac Teleop framework into LeRobot, an open-source robotics library, to provide developers with shared tools for training, evaluating, and deploying robot foundation models. NVIDIA Cosmos 3, a frontier world model for physical AI, is also set to be integrated soon.
LeRobot v0.6.0 introduces world model policies that learn to imagine the future, new VLAs, and a reward models API. It also includes six new simulation benchmarks, improved dataset handling with depth support and language annotations, and deployment tools like lerobot-rollout.
1X has launched the 1X World Model Lab, a new research organization dedicated to accelerating the development of fully autonomous humanoids through large-scale embodied world model pretraining. The lab is led by Sam Sinha, a former research scientist at Luma AI, and focuses on integrating diverse data sources to build robust and generalizable models. The initiative aims to close the full learning loop from data curation to real-world deployment.
Dexterity introduces Foresight, a world model that enables robots to reason about the physical world, predict outcomes, and act confidently in real environments. Trained on over 100 million autonomous actions in production, Foresight is designed for interpretability, safety, and performance, with capabilities like predictive branching and pragmatic decision-making. It addresses complex tasks like spatial packing and includes a game and API challenge for further exploration.
Dexterity introduces 'Transactable World Models' as a foundational component for Physical AI, emphasizing interpretability, physics integration, and real-time consistency. The approach treats world models as operators rather than data stores, enabling multi-agent coordination and robust manipulation in complex environments. This contrasts with traditional world models that focus on data compression and replay, lacking causal reasoning and physical grounding.
Hugging Face announces LeRobot v0.4.0, a major upgrade for open-source robotics with Dataset v3.0, new VLA models like PI0.5 and GR00T N1.5, and a plugin system for hardware integration. The release also adds support for LIBERO and Meta-World simulations, multi-GPU training, and a new Hugging Face Robot Learning Course.
Article dates follow your selected timezone. Briefing editions use Hong Kong time (UTC+8).