Speech Emotion Recognition using Deep Convolutional Neural Networks improved by the fast Continuous Wavelet Transform

Publication date

2023

Authors

Zwol, B. E. vanISNI 0000000512642753
Langezaal, Mathijs AISNI 0000000524043109
Arts, Lukas Petrus AnthoniusISNI 0000000512489883
Gatt, AlbertORCID 0000-0001-6388-8244ISNI 0000000048277966
van den Broek, E.L.ORCID 0000-0002-2017-0141ISNI 0000000395166232

Editors

Bekaroo, Girish
Ben Allouch, Somaya
Mecella, Massimo

Advisors

Supervisors

Document Type

Part of book
Open Access logo

License

cc_by_nc

Abstract

The fast Continuous Wavelet Transform (fCWT) is used to improve Deep Convolutional Neural Networks (DCNN)’s Speech Emotion Recognition (SER). While being computationally efficient, the fCWT’s time-frequency analysis overcomes traditional methods’ resolution limitations (e.g., Short-Term Fourier Transform). fCWT-induced DCNNs are compared to state-of-the-art DCNN SER systems. Comparing different wavelet parameters, we also provide an empirical strategy for balancing temporal and spectral features in speech signals. We suggest that this strategy is of generic interest for non-stationary signal processing where large amounts of data are available. fCWT’s potential for improving SER accuracy in real-time applications is confirmed. In parallel, the variance in the cross-validation folds confirmed deep learning’s vulnerability on non-big data sets.

Keywords

Deep Learning, Deep Convolutional Neural Networks, Signal Processing, Continuous Wavelet Transform, fCWT, Speech Emotion Recognition

Citation

Van Zwol, BE, Langezaal, MA, Arts, LPA, Gatt, A & Van den Broek, EL 2023, Speech Emotion Recognition using Deep Convolutional Neural Networks improved by the fast Continuous Wavelet Transform. in G Bekaroo, S Ben Allouch & M Mecella (eds), Workshop Proceedings of the 19th International Conference on Intelligent Environments (IE2023). Ambient Intelligence and Smart Environments, vol. 32, IOS Press, pp. 63-72. https://doi.org/10.3233/AISE230012