MEGA Hub

CameraAnything: Refilming Videos with Arbitrary Camera Control

Authors

Do you know Yixuan Li?You can claim authorship or link another user.Do you know Yanhong Zeng?You can claim authorship or link another user.Do you know Ka Leong Cheng?You can claim authorship or link another user.Do you know Jiayi Zhu?You can claim authorship or link another user.Do you know Hanlin Wang?You can claim authorship or link another user.Do you know Wen Wang?You can claim authorship or link another user.Do you know Yihao Meng?You can claim authorship or link another user.Do you know Hao Ouyang?You can claim authorship or link another user.Do you know Qiuyu Wang?You can claim authorship or link another user.Do you know Yue Yu?You can claim authorship or link another user.Do you know ZiDong Wang?You can claim authorship or link another user.Do you know Yiyuan Zhang?You can claim authorship or link another user.Do you know Yujun Shen?You can claim authorship or link another user.Do you know Dahua Lin?You can claim authorship or link another user.

Abstract

We introduce CameraAnything, the first unified framework for camera controlled video editing that enables joint control of both intrinsic and extrinsic camera parameters. Existing approaches either rely on expensive 3D reconstruction to achieve full camera functionality or restrict editing to extrinsic parameter manipulation. Moreover, the coupled influence of intrinsic and extrinsic parameters on video appearance makes disentangled modeling particularly challenging. To address this, we adopt per-pixel Plücker ray injection alongside resolution-aware 3D RoPE in self-attention, building both camera conditioning and spatial positional encoding on the target latent to jointly control camera position, focal length, and native resolution editing without cropping or outpainting. To overcome the scarcity of paired training data, we further develop a scalable synthetic pipeline that constructs diverse dynamic scenes through structured multi-camera recording and generates synchronized videos with varied camera configurations. With a tailored orthogonal training strategy, CameraAnything enables expressive video reshooting with arbitrary viewpoint control, focal length adjustment, resolution adaptation, and multi-shot transitions within a single generation process, offering strong practical value for cinematic video editing and cross-platform content adaptation in video production.

Community

00

Publication notes

Author note
Project page: https://yixuanli98.github.io/cameraanything/