MEGA Hub

InSight-doc: Agentic Visual Perception for Long-Document Understanding

Authors

Do you know Kaican Li?You can claim authorship or link another user.Do you know Weiyan Xie?You can claim authorship or link another user.Do you know Lewei Yao?You can claim authorship or link another user.Do you know Jiannan Wu?You can claim authorship or link another user.Do you know Lanqing Hong?You can claim authorship or link another user.Do you know Yongxiang Huang?You can claim authorship or link another user.Do you know Nevin L. Zhang?You can claim authorship or link another user.

Abstract

Long-document understanding often requires reasoning over many visually rich pages, making inference costly and prone to context rot. In this work, we propose InSight-doc, an agentic visual perception framework that treats visual resolution as an adaptive reasoning-time resource. InSight-doc starts from low resolution and selectively zooms into high-resolution regions for finer evidence, without relying on any external retriever. To train such an agent, we construct an active-perception corpus of 17.9K high-quality SFT examples with region-level zoom-in trajectories, accompanied by 19.2K hard RL examples. Through SFT+RL, InSight-doc-8B improves the baseline by 4.3--16.4 accuracy points over document VQA benchmarks. On long documents, it reduces hallucination by more than 40% and inference latency by 41%--68% while maintaining an accuracy lead. Our code, datasets, and model are released at https://github.com/m-Just/InSight-doc .

Community

00