MEGA Hub

Towards Professional Tennis Styles for Humanoid Robots with Adaptive Motion Planning and Tracking

Authors

Do you know Tao Huang?You can claim authorship or link another user.Do you know Ruofei Liu?You can claim authorship or link another user.Do you know Xuchen Tang?You can claim authorship or link another user.Do you know Xinyin Zhang?You can claim authorship or link another user.Do you know Junli Ren?You can claim authorship or link another user.Do you know Huayi Wang?You can claim authorship or link another user.Do you know Feiyu Jia?You can claim authorship or link another user.Do you know Yukai Qi?You can claim authorship or link another user.Do you know Kangning Yin?You can claim authorship or link another user.Do you know Weishuai Zeng?You can claim authorship or link another user.Do you know Lipeng Chen?You can claim authorship or link another user.Do you know Xi Li?You can claim authorship or link another user.Do you know Ting Wu?You can claim authorship or link another user.Do you know Kailin Li?You can claim authorship or link another user.Do you know Ruoli Dai?You can claim authorship or link another user.Do you know Jingbo Wang?You can claim authorship or link another user.Do you know Lei Han?You can claim authorship or link another user.Do you know Jiangmiao Pang?You can claim authorship or link another user.

Abstract

Humanoid robots have recently demonstrated promising capabilities in real-world ball sports. However, achieving professional motion styles while maintaining strong task performance remains challenging. In this work, we propose AdaPT, an Adaptive Motion Planning and Tracking framework that learns professional tennis serving and rally styles directly from broadcast videos. This hierarchical design is motivated by the key insight that the planner generates stylistic kinematic motions, while the tracker executes them with minimal interference with planning. Despite its effectiveness in simulation, a substantial sim-to-real gap emerges: tracking performance inevitably degrades on real robots, and this degradation is partially overlooked by autoregressive planning and further compounded by noisy perception. To address these issues, our adaptation mechanism improves tracking robustness by learning to track randomized execution speeds, while conditioning the planner on a learned motion-speed adapter to mitigate compounding errors. Real-world experiments on the Unitree G1 demonstrate the effectiveness of our adaptation mechanism in bridging the sim-to-real gap. We further deploy AdaPT policies on the full-size Dobot Atom humanoid robot (1.7m) and demonstrate in-the-wild serving without motion capture. Beyond these results, our real-world experiments reveal both algorithmic and engineering insights for future humanoid ball-sports systems. Videos and code are available on our \href{https://humanoidtennis.github.io/AdaPT/}{project website}.

Community

00

Publication notes

Author note
14 pages