MEGA Hub

DynaBridge: Dynamic Summary-Guided Cross-Task Multimodal Fusion for DASS-Structured Mental Health Assessment

Authors

Do you know Shiyu Teng?You can claim authorship or link another user.Do you know Haichen Yu?You can claim authorship or link another user.Do you know Jiaqing Liu?You can claim authorship or link another user.Do you know Hao Sun?You can claim authorship or link another user.Do you know Yu Song?You can claim authorship or link another user.Do you know Shurong Chai?You can claim authorship or link another user.Do you know Ruibo Hou?You can claim authorship or link another user.Do you know Lanfen Lin?You can claim authorship or link another user.Do you know Yen-Wei Chen?You can claim authorship or link another user.

Abstract

Multimodal behavioral analysis offers a scalable approach to assessing depression, anxiety, and stress, yet generic fusion models often ignore the psychometric structure of questionnaire labels. In DASS-21, risk labels are derived from ordered symptom items through fixed item-to-subscale mappings. We propose \textbf{DynaBridge}, a dynamic summary-guided cross-task multimodal framework for DASS-structured mental health assessment. DynaBridge encodes acoustic, visual, and textual cues across multiple sessions and augments them with frozen-LLM-generated DASS-aware summaries as participant-level semantic evidence. It predicts ordinal item distributions, reconstructs depression, anxiety, and stress risk evidence from item-level soft scores, and fuses this evidence with direct multimodal risk predictions. A confidence-aware refinement strategy further incorporates high-confidence semantic cues conservatively. On the official AdoDAS validation split, DynaBridge outperforms the official baseline and representative multimodal methods, achieving 0.5012 mean F1 for D/A/S risk prediction and 0.3216 mean QWK for DASS-21 item prediction. These results show the value of bridging multimodal cues, semantic summaries, and DASS-21 psychometric structure.

Community

00