Sorry, you need to enable JavaScript to visit this website.

facebooktwittermailshare

PHOTOREALISTIC ADAPTATION AND INTERPOLATION OF FACIAL EXPRESSIONS USING HMMS AND AAMS FOR AUDIO-VISUAL SPEECH SYNTHESIS

Abstract: 

In this paper, motivated by the continuously increasing presence of intelligent agents in everyday life, we address the problem of expres-sive photorealistic audio-visual speech synthesis, with a strong focus on the visual modality. Emotion constitutes one of the main driving factors of social life and it is expressed mainly through facial expres-sions. Synthesis of a talking head capable of expressive audio-visual speech is challenging due to the data overhead that arises when con-sidering the vast number of emotions we would like the talking head to express. In order to tackle this challenge, we propose the usage of two methods, namely Hidden Markov Model (HMM) adaptation and interpolation, with HMMs modeling visual parameters via an Active Appearance Model (AAM) of the face. We show that through HMM adaptation we can successfully adapt a “neutral” talking head to a target emotion with a small amount of adaptation data, as well as that through HMM interpolation we can robustly achieve different levels of intensity for an emotion.

up
0 users have voted:

Paper Details

Authors:
Athanasios Katsamanis, Petros Maragos
Submitted On:
16 September 2017 - 12:51pm
Short Link:
Type:
Poster
Event:
Presenter's Name:
PANAGIOTIS PARASKEVAS FILNTISIS
Paper Code:
TA-PA.5
Document Year:
2017
Cite

Document Files

pf_poster_icip-2017.pdf

(77 downloads)

Subscribe

[1] Athanasios Katsamanis, Petros Maragos, "PHOTOREALISTIC ADAPTATION AND INTERPOLATION OF FACIAL EXPRESSIONS USING HMMS AND AAMS FOR AUDIO-VISUAL SPEECH SYNTHESIS ", IEEE SigPort, 2017. [Online]. Available: http://sigport.org/2200. Accessed: May. 26, 2018.
@article{2200-17,
url = {http://sigport.org/2200},
author = {Athanasios Katsamanis; Petros Maragos },
publisher = {IEEE SigPort},
title = {PHOTOREALISTIC ADAPTATION AND INTERPOLATION OF FACIAL EXPRESSIONS USING HMMS AND AAMS FOR AUDIO-VISUAL SPEECH SYNTHESIS },
year = {2017} }
TY - EJOUR
T1 - PHOTOREALISTIC ADAPTATION AND INTERPOLATION OF FACIAL EXPRESSIONS USING HMMS AND AAMS FOR AUDIO-VISUAL SPEECH SYNTHESIS
AU - Athanasios Katsamanis; Petros Maragos
PY - 2017
PB - IEEE SigPort
UR - http://sigport.org/2200
ER -
Athanasios Katsamanis, Petros Maragos. (2017). PHOTOREALISTIC ADAPTATION AND INTERPOLATION OF FACIAL EXPRESSIONS USING HMMS AND AAMS FOR AUDIO-VISUAL SPEECH SYNTHESIS . IEEE SigPort. http://sigport.org/2200
Athanasios Katsamanis, Petros Maragos, 2017. PHOTOREALISTIC ADAPTATION AND INTERPOLATION OF FACIAL EXPRESSIONS USING HMMS AND AAMS FOR AUDIO-VISUAL SPEECH SYNTHESIS . Available at: http://sigport.org/2200.
Athanasios Katsamanis, Petros Maragos. (2017). "PHOTOREALISTIC ADAPTATION AND INTERPOLATION OF FACIAL EXPRESSIONS USING HMMS AND AAMS FOR AUDIO-VISUAL SPEECH SYNTHESIS ." Web.
1. Athanasios Katsamanis, Petros Maragos. PHOTOREALISTIC ADAPTATION AND INTERPOLATION OF FACIAL EXPRESSIONS USING HMMS AND AAMS FOR AUDIO-VISUAL SPEECH SYNTHESIS [Internet]. IEEE SigPort; 2017. Available from : http://sigport.org/2200