Towards using Breathing Features for Multimodal Estimation of Depression Severity
Publication date
2022-11-07
Editors
Advisors
Supervisors
Document Type
Part of book
Metadata
Show full item recordCollections
License
taverne
Abstract
Breathing patterns are shown to have strong correlations with emotional states, and hence have promise for automatic mood order prediction and analysis. An essential challenge here is the lack of ground truth for breathing sounds, especially for medical and archival datasets. In this study, we provide a cross-dataset approach for breathing pattern prediction and analyse the contribution of predicted breath signals for the detection of depressive states, using the DAIC-WOZ corpus. We use interpretable features in our models to provide actionable insights. Our experimental evaluation shows that in participants with higher depression scores (as indicated by the eight-item Patient Health Questionnaire, PHQ-8), breathing events tend to be shallow or slow. We furthermore tested linear and non-linear regression models with breathing, linguistic sentiment and conversational features, and show that these simple models outperform the AVEC17 Real-life Depression Recognition Sub-challenge baseline.
Keywords
Affective Computing, Paralinguistics, Interpretability, Breathing Analysis, Depression Severity Prediction, DAIC-WOZ Corpus, Taverne
Citation
Pessanha, F, Kaya, H, Salah, A A A & Salah, A A 2022, Towards using Breathing Features for Multimodal Estimation of Depression Severity. in ICMI '22: Proceedings of the 2022 International Conference on Multimodal Interaction. Association for Computing Machinery, pp. 128-138, 24th ACM International Conference on Multimodal Interaction, Bengaluru, India, 7/11/22. https://doi.org/10.1145/3536221.3556606, conference