Research Area:  Machine Learning

Abstract:

Depression is a common mental disease that has a tendency to develop at a younger age. Early detection of depression with psychological intervention may effectively prevent youth suicide. The establishment of the computer-aided model may be efficient for early detection. However, the existing methods of automatic detection for depression mostly rely on unimodal data. Clinical research shows that patients with depression have specificity in speech, text, expression, and other modal data. Multimodal machine learning is emerging but not yet widely used for the detection of psychiatric disorders. The problem of existing multimodal detection models is that only global or local information is considered in feature fusion, which leads to the low accuracy of the depression detection model. Therefore, this study constructs an automatic detection model based on multimodal machine learning for adolescent depression. The proposed method first extracted four features from audio and text globally and locally; then construct a coarse-grained fusion model and fine-grained fusion model base on these four features; and fuse the coarse-grained and the fine-grained fusion model finally. Experiments on the real-world dataset demonstrate that the proposed method could improve the accuracy of depression detection automatically.

Keywords:  
depression detection
multimodal data fusion
attention mechanism
deep learning

Author(s) Name:  Lei Zhang, Yuanxiao Fan, Jingwen Jiang, Yuchen Li, and Wei Zhang

Publisher name:  World Scientific

DOI:  https://doi.org/10.1142/S0129065722500459

Volume Information:  Volume 32

Paper Link:   https://www.worldscientific.com/doi/abs/10.1142/S0129065722500459