Multimodal machine learning for video based single question mental health assessment.
cross_sectional · Level IV
Where this comes from
- Record sourced from PubMed, PMID 41402520.
- Also identified by DOI 10.1038/s41746-025-02242-5 and PMC identifier 12824363.
- Licence recorded as CC BY-NC-ND.
- Because redistribution is not established, this page shows the abstract only. Follow the links below for the full text.
Abstract
This study demonstrates that a single video question can predict self-reported depression (PHQ-9), anxiety (GAD-7), and trauma (PCL-5) through text and voice analysis. As mental health screening needs increase, efficient multi-condition assessment methods could reduce patient burden in clinical settings. Our multimodal model, integrating MPNet for textual analysis and HuBERT for voice prosody, was trained on data from 2420 participants. Our approach achieves 64.6% reduced assessment time (78.4 s vs 221.7 s) while screening all three conditions from one response, with only 1.4% of participants unwilling to use video-based screening. Results demonstrate strong performance and demographic consistency across age, gender, and race/ethnicity supporting the feasibility of efficient multi-condition screening from brief video responses.