MEGA Hub

LeapBot-WA: World-Anchor Action Models via Predictive Latent Alignments

Authors

Do you know Pei Liu?You can claim authorship or link another user.Do you know Nan Zheng?You can claim authorship or link another user.Do you know Lang Zhang?You can claim authorship or link another user.Do you know Daojie Peng?You can claim authorship or link another user.Do you know Yanan Zhang?You can claim authorship or link another user.Do you know Feilong Kong?You can claim authorship or link another user.Do you know Mingyue Feng?You can claim authorship or link another user.Do you know Jiachao Liu?You can claim authorship or link another user.Do you know Yaonong Wang?You can claim authorship or link another user.Do you know Qifeng Chen?You can claim authorship or link another user.Do you know Jun Ma?You can claim authorship or link another user.

Abstract

World Action Models (WAMs) have emerged as a powerful paradigm for embodied intelligence, yet the prevailing reliance on pixel-level video generation creates a fundamental bottleneck. Forcing models to reconstruct task-irrelevant visual details dissipates representational capacity and renders policies vulnerable to visual distractors. In this paper, we propose LeapBot-WA, which establishes a novel Predictive-Latent paradigm for WAMs by operationalizing the Joint-Embedding Predictive Architecture (JEPA) as a World-Anchor. Departing from the traditional reliance on visual synthesis, LeapBot-WA shifts the core of world modeling to Predictive Semantic Alignment, extracting abstract physical dynamics directly within a latent foundation space. To bridge the modality gap between non-Gaussian predictive features and diffusion priors, we introduce the Isotropic Semantic Autoencoder (ISAE), which reshapes the anchor's latent space into a diffusion-friendly manifold to prevent off-manifold drift. Furthermore, we design an Asymmetric Mixture-of-Transformers (MoT) architecture. During training, an Anchor Diffusion Transformer acts as a privileged dynamics expert to guide the Action Diffusion Transformer; at inference, this heavy dynamics branch is pruned, enabling zero-overhead execution. LeapBot-WA achieves state-of-the-art performance among predictive models on LIBERO and matches top-tier generative WAMs on RoboTwin 2.0 without requiring large-scale trajectory pre-training. It further demonstrates superior zero-shot robustness to unseen environments and successful real-world transfer, establishing a highly efficient and robust latent-centric paradigm for scalable robotic control. Code: https://github.com/LeapWM/leapbot-wa.

Community

00