Wheeled, flying and six-legged robots stay on track with new learning method
Wheeled, flying and six-legged robots stay on track with new learning method
A new reinforcement learning method called CARL (Contraction-Aware Reinforcement Learning) has been developed to improve robot tracking performance and stability. By integrating reinforcement learning with contraction theory, the method provides mathematical guarantees on tracking errors, allowing robots to stay on track and reach goals faster. The approach was tested on three types of robots, including a wheeled TurboBot 3 Burger, a flapping aerial drone, and a six-legged Jethexa robot, showing up to 15% better performance in real-world testing compared to existing methods.
This research introduces CARL, a contraction-aware reinforcement learning method that improves robot tracking performance by up to 15% while ensuring stability. The approach combines reinforcement learning with contraction theory to provide mathematical guarantees on tracking errors, addressing the sim-to-real gap through experiments with wheeled, aerial, and six-legged robots.
Source: Tech Xplore — Robotics · Read original article ↗
Article text · Original source · English
It's important for a robot not just to learn a task optimally, but to complete it without going off the rails of reasonable expectations. Until now, roboticists could have one or the other. Aerospace engineering researchers in The Grainger College of Engineering, University of Illinois Urbana-Champaign, combined reinforcement learning with control theory to guarantee robot stability and improve tracking performance by up to 15% compared with existing methods.
The study, "Contraction-Aware Reinforcement Learning for Nonlinear Control with Statistical Robustness," by Minjae Cho, Hiroyasu Tsukamoto and Huy T. Tran, is published in IEEE Transactions on Robotics.
"Reinforcement learning offers a promising way for robots to learn effective behavior, but it often lacks stability guarantees," said Ph.D. student Minjae Cho, whose advisers are Huy Tran and Hiro Tsukamoto.
"Without confidence that a robot will remain stable, deploying it in practice is difficult. In a worst-case scenario, it could break and require costly repairs. So, guaranteeing stability of the robot as well as ensuring it can learn effective behavior is the key idea of this project."
Keeping robot learning on track
Reinforcement learning is like the hot/cold game you may have played as a child. One person knows where an object is in a room. When the other person, who is blindfolded, moves in a direction, the first says "hot" if they are getting closer to the object and "cold" if they're moving away from the object, providing real-time feedback until the person is successful.
With Cho's new method called CARL, which stands for Contraction-Aware Reinforcement Learning, the robot consistently stays on track and reaches its goal faster.
"CARL combines reinforcement learning with contraction theory to provide stability guarantees for its performance. Small tracking errors may occur, but the method provides mathematical limits on how large they can become. This allows reinforcement learning to serve as the robot's main controller with stability guarantees."
Closing the sim-to-real gap
Cho began by simulating CARL, then moved to the aerospace engineering flight lab to test it with multiple real robots.
"There is a difference between the model we train in the computer world and the physical robot in the real world. For example, a model in the simulator has a mass of 1 kilogram (2.2 pounds). In the real world, it may be 1.2 kilograms (2.6 pounds). This is called the sim-to-real gap, but our algorithm was shown to be better at handling those uncertainties."
Cho ran experiments with three types of robots: a wheeled TurboBot 3 Burger, a flapping aerial drone and a six-legged Jethexa robot. He created a video that overlays the robots' progress with previous algorithms and CARL.
"There was no guarantee that our method would work better than the existing methods, particularly with the increasing complexity of the robots we tested. But we found that not only was integrating those two methods novel, but the performance achieved in the computer world is consistently better in the real-world testing as well, by up to 15%."
Cho said one example of how this method can be applied is with wildfire management. First responders could send in robots to help identify hot spots or even deliver supplies.
CARL has open-access availability, with code also provided on GitHub.
Publication details
Minjae Cho et al., Contraction-Aware Reinforcement Learning for Nonlinear Control with Statistical Robustness, IEEE Transactions on Robotics (2026). DOI: 10.1109/tro.2026.3727138
Who's behind this story?
Sadie Harley
BSc Life Sciences & Ecology. Microbiology lab background with pharmaceutical news experience in oil, gas, and renewable industries. Full profile →
Robert Egan
Bachelor's in mathematical biology, Master's in creative writing. Well-traveled with unique perspectives on science and language. Full profile →
Citation: Wheeled, flying and six-legged robots stay on track with new learning method (2026, October 21) retrieved 21 October 2026 from https://techxplore.com/news/2026-10-wheeled-flying-legged-robots-stay.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.
Source：Tech Xplore — Robotics · techxplore.com