Sorry, you need to enable JavaScript to visit this website.

Affect Recognition from Lip Articulations

Primary tabs

Citation Author(s):
Rizwan Sadiq, Engin Erzin
Submitted by:
Engin Erzin
Last updated:
23 March 2017 - 1:44pm
Document Type:
Poster
Document Year:
2017
Event:
Presenters Name:
Rizwan Sadiq
Paper Code:
MLSP-P1.05

Abstract 

Abstract: 

Lips deliver visually active clues for speech articulation. Affective states define how humans articulate speech; hence, they also change articulation of lip motion. In this paper, we investigate effect of phonetic classes for affect recognition from lip articulations. The affect recognition problem is formalized in discrete activation, valence and dominance attributes. We use the symmetric Kullback-Leibler divergence (KLD) to rate phonetic classes with larger discrimination across different affective states. We perform experimental evaluations using the IEMOCAP database. Our results demonstrate that lip articulations over a set of discriminative phonetic classes improves the affect recognition performance, and attains 3-class recognition rates for the activation, valence and dominance (AVD) attributes as 72.16%, 46.44% and 64.92%, respectively.

up
0 users have voted:

Dataset Files

sadiq-erzin-icassp17.pdf

(468)