MEGA Hub

MedUAG: Unified Understanding and Generation for Medical Multimodal Models

Authors

Do you know Zijie Meng?You can claim authorship or link another user.Do you know Yuncheng Zhang?You can claim authorship or link another user.Do you know Hualiang Wang?You can claim authorship or link another user.Do you know Yitian Tang?You can claim authorship or link another user.Do you know Xiaotang Gai?You can claim authorship or link another user.Do you know Chen Shen?You can claim authorship or link another user.Do you know Songtao Jiang?You can claim authorship or link another user.Do you know Shaosheng Cao?You can claim authorship or link another user.Do you know Jian Wu?You can claim authorship or link another user.Do you know Xian Wu?You can claim authorship or link another user.Do you know Zuozhu Liu?You can claim authorship or link another user.

Abstract

Recent Multimodal Large Language Models (MLLMs) are rapidly evolving into unified understanding and generation (UAG) frameworks. However, extending these unified paradigms to the medical domain is hindered by: the absence of comprehensive training and evaluation benchmarks, and the lack of broadly validated unified medical model. To address these gaps, we present a comprehensive foundation for medical UAG. First, we construct MedUAGCorpus, the largest unified medical understanding and generation dataset to date, comprising over 6 million instances across 14 imaging modalities. Second, we introduce MedUAGBench, a systematic benchmark that expands medical generation evaluation to 12 diverse tasks under standardized protocols. Finally, leveraging these resources, we develop MedUAG, an end-to-end trained unified medical model. Extensive experiments demonstrate that MedUAG achieves strong performance across a wide array of understanding and generation tasks, establishing a competitive baseline and paving the way for next-generation medical multimodal systems.

Community

00