MEGA Hub

MIRA: Medical Image Reflection for Agentic Diagnosis

Authors

Do you know Shengzhi Wang?You can claim authorship or link another user.Do you know Jun Yang?You can claim authorship or link another user.Do you know Kai Wu?You can claim authorship or link another user.Do you know Xiaozhong Ji?You can claim authorship or link another user.Do you know Yiwen Ye?You can claim authorship or link another user.Do you know Ziyang Chen?You can claim authorship or link another user.Do you know Mingliang Xiong?You can claim authorship or link another user.Do you know Wen Fang?You can claim authorship or link another user.Do you know Mingqing Liu?You can claim authorship or link another user.Do you know Mengyuan Xu?You can claim authorship or link another user.Do you know Miaoxuan Shan?You can claim authorship or link another user.Do you know Caiyan Liu?You can claim authorship or link another user.Do you know Bin He?You can claim authorship or link another user.Do you know Qingwen Liu?You can claim authorship or link another user.

Abstract

Medical visual agents can use tools to inspect images and retrieve external knowledge, but indiscriminate tool use may introduce noisy or misleading evidence. Reliable diagnosis therefore requires not only acquiring additional observations, but also verifying whether tool actions are necessary and whether the resulting evidence supports the current hypothesis. We introduce MIRA (Medical Image Reflection for Agentic Diagnosis), a medical visual diagnostic framework for autonomous evidence search and reflective verification. MIRA dynamically invokes image-processing operations, including zooming, grounding, pointing, rotation, and measurement, as well as web search, while evaluating the relevance and consistency of the acquired evidence. We develop MIRA through a two-stage training strategy. First, a tool-augmented Monte Carlo Tree Search data engine explores diverse diagnostic hypotheses and jointly verifies visual grounding accuracy and semantic consistency to construct supervised fine-tuning trajectories. Second, reinforcement learning further improves decision-making through online reflective principle evolution: failure cases are distilled into candidate principles, and only principles that improve held-out rollout rewards are retained. Across nine medical visual reasoning benchmarks, MIRA achieves an average score of 64.73, improving its Qwen3-VL-8B backbone by 7.44 points. It also increases useful tool-use judgments from 56.2% to 73.8% and reduces harmful judgments from 8.9% to 1.6%. Qualitative analyses show that MIRA can re-examine evidence, correct premature conclusions, and adapt its tool-use strategy. Project page: https://MIRA-VL.github.io/

Community

00