MEGA Hub

Binarized High-Efficiency RAW Video Restoration and Beyond

Authors

Do you know Tianyu Zhu?You can claim authorship or link another user.Do you know Ying Fu?You can claim authorship or link another user.Do you know Hesong Li?You can claim authorship or link another user.Do you know Gengchen Zhang?You can claim authorship or link another user.Do you know Xin Yuan?You can claim authorship or link another user.Do you know Yulun Zhang?You can claim authorship or link another user.

Abstract

RAW video restoration is fundamental to high-quality low-level perception and serves as the basis for a wide range of downstream vision applications. While binary neural networks (BNNs) enable efficient lightweight deployment for image enhancement, their deficiencies in modeling temporal coherence and activation value distributions hinder their effectiveness when applied to video scenarios. In this paper, we propose BinRVR, a binarized RAW video restoration framework that reduces computation and parameters by approximately 96% while incurring only about 4% performance degradation. Specifically, we present a Binarized Information Interaction Module (BIIM) to jointly model spatial and temporal information in an efficient and unified manner. Moreover, we develop a Distribution-Aware Binarized Convolution (DAB-Conv) that leverages the statistics of full-precision activations to mitigate quantization errors. The proposed framework further supports multi-bit quantization, enabling flexible accuracy-efficiency trade-offs across different hardware constraints. Extensive experiments demonstrate that our BinRVR achieves competitive performance compared with state-of-the-art binarized methods on RAW video restoration tasks, including low-light enhancement, denoising, deblurring, and super-resolution. We further explore the potential of our method on downstream video applications, including object detection and monocular depth estimation.

Community

00

Publication notes

Author note
Accepted by TPAMI2026