MEGA Hub

Wan-Animate-2: Pushing the Application Boundaries of Character Animation

Authors

Do you know Guangyuan Wang?You can claim authorship or link another user.Do you know Li Hu?You can claim authorship or link another user.Do you know Dechao Meng?You can claim authorship or link another user.Do you know Zhongyi Zhang?You can claim authorship or link another user.Do you know Peng Zhang?You can claim authorship or link another user.Do you know Mingyang Huang?You can claim authorship or link another user.Do you know Ruoshi Zhang?You can claim authorship or link another user.Do you know Ke Sun?You can claim authorship or link another user.Do you know Zhe Zhang?You can claim authorship or link another user.Do you know Xingjun Wang?You can claim authorship or link another user.Do you know Gang Cheng?You can claim authorship or link another user.Do you know Bang Zhang?You can claim authorship or link another user.

Abstract

Character image animation remains a foundational yet challenging task in computer vision. Existing approaches can be broadly categorized into three paradigms: methods based on explicit motion representations suffer from extraction errors and identity drift; methods based on implicit motion features lose fine-grained dynamics through compression; and in-context learning approaches avoid intermediate representations but incur prohibitive computational costs. Furthermore, all current systems are designed for offline synthesis, unable to meet the real-time requirements of interactive applications such as digital avatars and live-streaming hosts. To address these limitations, we present Wan-Animate-2, an end-to-end character animation framework that directly consumes the driving video within a redesigned Diffusion Transformer. Our architecture achieves superior motion fidelity and identity preservation by eliminating intermediate motion extractors entirely. We further introduce text driven viewpoint control that decouples the output camera perspective from the driving video--a capability rarely supported by prior character animation methods that rely on explicit motion representations. Beyond generation quality, we present Wan-Animate-2-Lite, an efficient variant that reduces inference latency to real-time thresholds through a three-stage training paradigm: teacher forcing pretraining with error buffer mechanism, and Self-Forcing distillation with chunk-wise backpropagation. This enables streaming character animation for interactive applications, opening new deployment scenarios that were previously infeasible. Qualitative evaluations and user studies demonstrate that Wan-Animate-2 achieves high-fidelity animation results across diverse characters and motion patterns. To foster further research and community development, we will release the Wan-Animate-2-Base model weights to the public.

Community

00

Publication notes

Author note
Project page: https://humanaigc.github.io/wan-animate-2/