Sorry, you need to enable JavaScript to visit this website.

facebooktwittermailshare

A 3D FACE MODELING APPROACH FOR IN-THE-WILD FACIAL EXPRESSION RECOGNITION ON IMAGE DATASETS

Abstract: 

This paper explores the benefits of 3D face modeling for in-the-wild facial expression recognition (FER). Since there is limited in-the-wild 3D FER dataset, we first construct 3D facial data from available 2D dataset using recent advances in 3D face reconstruction. The 3D facial geometry representation is then extracted by deep learning technique. In addition, we also take advantage of manipulating the 3D face, such as using 2D projected images of 3D face as additional input for FER. These features are then fused with that of 2D FER typical network. By doing so, despite using common approaches, we achieve a competent recognition accuracy on Real-World Affective Faces (RAF) database and Static Facial Expressions in the Wild (SFEW 2.0) compared with the state-of-the-art reports. To the best of our knowledge, this is the first time such a deep learning combination of 3D and 2D facial modalities is presented in the context of in-the-wild FER.

up
0 users have voted:

Paper Details

Authors:
Son Thai Ly, Nhu-Tai Do, Guee-Sang Lee, Soo-Hyung Kim, Hyung-Jeong Jang
Submitted On:
16 September 2019 - 10:43pm
Short Link:
Type:
Poster
Event:
Presenter's Name:
Nhu-Tai Do
Paper Code:
1895
Document Year:
2019
Cite

Document Files

SonLy - 3DFaceModelling - ICIP2019 poster.pdf

(27)

Subscribe

[1] Son Thai Ly, Nhu-Tai Do, Guee-Sang Lee, Soo-Hyung Kim, Hyung-Jeong Jang, "A 3D FACE MODELING APPROACH FOR IN-THE-WILD FACIAL EXPRESSION RECOGNITION ON IMAGE DATASETS", IEEE SigPort, 2019. [Online]. Available: http://sigport.org/4649. Accessed: Dec. 12, 2019.
@article{4649-19,
url = {http://sigport.org/4649},
author = {Son Thai Ly; Nhu-Tai Do; Guee-Sang Lee; Soo-Hyung Kim; Hyung-Jeong Jang },
publisher = {IEEE SigPort},
title = {A 3D FACE MODELING APPROACH FOR IN-THE-WILD FACIAL EXPRESSION RECOGNITION ON IMAGE DATASETS},
year = {2019} }
TY - EJOUR
T1 - A 3D FACE MODELING APPROACH FOR IN-THE-WILD FACIAL EXPRESSION RECOGNITION ON IMAGE DATASETS
AU - Son Thai Ly; Nhu-Tai Do; Guee-Sang Lee; Soo-Hyung Kim; Hyung-Jeong Jang
PY - 2019
PB - IEEE SigPort
UR - http://sigport.org/4649
ER -
Son Thai Ly, Nhu-Tai Do, Guee-Sang Lee, Soo-Hyung Kim, Hyung-Jeong Jang. (2019). A 3D FACE MODELING APPROACH FOR IN-THE-WILD FACIAL EXPRESSION RECOGNITION ON IMAGE DATASETS. IEEE SigPort. http://sigport.org/4649
Son Thai Ly, Nhu-Tai Do, Guee-Sang Lee, Soo-Hyung Kim, Hyung-Jeong Jang, 2019. A 3D FACE MODELING APPROACH FOR IN-THE-WILD FACIAL EXPRESSION RECOGNITION ON IMAGE DATASETS. Available at: http://sigport.org/4649.
Son Thai Ly, Nhu-Tai Do, Guee-Sang Lee, Soo-Hyung Kim, Hyung-Jeong Jang. (2019). "A 3D FACE MODELING APPROACH FOR IN-THE-WILD FACIAL EXPRESSION RECOGNITION ON IMAGE DATASETS." Web.
1. Son Thai Ly, Nhu-Tai Do, Guee-Sang Lee, Soo-Hyung Kim, Hyung-Jeong Jang. A 3D FACE MODELING APPROACH FOR IN-THE-WILD FACIAL EXPRESSION RECOGNITION ON IMAGE DATASETS [Internet]. IEEE SigPort; 2019. Available from : http://sigport.org/4649