Sorry, you need to enable JavaScript to visit this website.

Dynamic Speech Emotion Recognition using a Conditional Neural Process

Citation Author(s):
Luz Martinez-Lucas, Carlos Busso
Submitted by:
Luz Martinez-Lucas
Last updated:
6 June 2024 - 10:21am
Document Type:
Document Year:
Luz Martinez-Lucas
Paper Code:

The problem of predicting emotional attributes from speech has often focused on predicting a single value from a sentence or short speaking turn. These methods often ignore that natural emotions are both dynamic and dependent on context. To model the dynamic nature of emotions, we can treat the prediction of emotion from speech as a time-series problem. We refer to the problem of predicting these emotional traces as dynamic speech emotion recognition. Previous studies in this area have used models that treat all emotional traces as coming from the same underlying distribution. Since emotions are dependent on contextual information, these methods might obscure the context of an emotional interaction. Our paper uses a neural process model with a segment-level speech emotion recognition (SER) model for this problem. This type of model leverages information from the time-series and predictions from the SER model to learn a prior that defines a distribution over emotional traces. Our proposed model performs 21% better than a bidirectional long short-term memory (BiLSTM) baseline when predicting emotional traces for valence. This poster provides an overview of our paper and proposed method.

0 users have voted: