Towards using Breathing Features for Multimodal Estimation of Depression Severity

Publication date

2022-11-07

Authors

Pessanha, FranciscaORCID 0000-0002-3711-7814ISNI 0000000524640122
Kaya, HeysemORCID 0000-0001-7947-5508ISNI 000000049289651X
Akdağ Salah, A. A.ORCID 0000-0002-7204-5633ISNI 0000000050543653
Salah, Albert AliORCID 0000-0001-6342-428XISNI 0000000091147032

Editors

Advisors

Supervisors

Document Type

Part of book
Open Access logo

License

taverne

Abstract

Breathing patterns are shown to have strong correlations with emotional states, and hence have promise for automatic mood order prediction and analysis. An essential challenge here is the lack of ground truth for breathing sounds, especially for medical and archival datasets. In this study, we provide a cross-dataset approach for breathing pattern prediction and analyse the contribution of predicted breath signals for the detection of depressive states, using the DAIC-WOZ corpus. We use interpretable features in our models to provide actionable insights. Our experimental evaluation shows that in participants with higher depression scores (as indicated by the eight-item Patient Health Questionnaire, PHQ-8), breathing events tend to be shallow or slow. We furthermore tested linear and non-linear regression models with breathing, linguistic sentiment and conversational features, and show that these simple models outperform the AVEC17 Real-life Depression Recognition Sub-challenge baseline.

Keywords

Affective Computing, Paralinguistics, Interpretability, Breathing Analysis, Depression Severity Prediction, DAIC-WOZ Corpus, Taverne

Citation

Pessanha, F, Kaya, H, Salah, A A A & Salah, A A 2022, Towards using Breathing Features for Multimodal Estimation of Depression Severity. in ICMI '22: Proceedings of the 2022 International Conference on Multimodal Interaction. Association for Computing Machinery, pp. 128-138, 24th ACM International Conference on Multimodal Interaction, Bengaluru, India, 7/11/22. https://doi.org/10.1145/3536221.3556606, conference