Sorry, you need to enable JavaScript to visit this website.

facebooktwittermailshare

AUTOMATIC TEMPORAL SEGMENTATION OF HAND MOVEMENTS FOR HAND POSITIONS RECOGNITION IN FRENCH CUED SPEECH

Abstract: 

In the context of Cued Speech (CS) recognition, the recognition
of lips and hand movements is a key task. As we know, a good
temporal segmentation is necessary for the supervised recog-
nition system. However, lips and hand streams cannot share
the same temporal segmentation since they are not synchro-
nized. In this work, we propose a hand preceding model to
predict temporal segmentations of hand movements automati-
cally by exploring the relationship between hand preceding time
and the vowel positions in sentences. To evaluate the perfor-
mance of the proposed method, we apply the hand preceding
model to a multi-speakers database. Hand positions recognition
is realized with the multi-Gaussian and Long-Short Term Mem-
ory (LSTM). The results show that using the predicted tempo-
ral segmentation significantly improves the recognition perfor-
mance compared with that using the audio based segmentation.
To the best of our knowledge, this is the first automatic method
to predict the temporal segmentation for hand movements only
from the audio based segmentation in CS.

up
0 users have voted:

Paper Details

Authors:
LI LIU, GANG FENG, DENIS BEAUTEMPS
Submitted On:
20 April 2018 - 1:08am
Short Link:
Type:
Poster
Event:
Presenter's Name:
Li LIU
Paper Code:
MMSP-P1.2
Document Year:
2018
Cite

Document Files

Poster_ICASSP_36032018.pdf

(53 downloads)

Subscribe

[1] LI LIU, GANG FENG, DENIS BEAUTEMPS, "AUTOMATIC TEMPORAL SEGMENTATION OF HAND MOVEMENTS FOR HAND POSITIONS RECOGNITION IN FRENCH CUED SPEECH", IEEE SigPort, 2018. [Online]. Available: http://sigport.org/3072. Accessed: Oct. 16, 2018.
@article{3072-18,
url = {http://sigport.org/3072},
author = {LI LIU; GANG FENG; DENIS BEAUTEMPS },
publisher = {IEEE SigPort},
title = {AUTOMATIC TEMPORAL SEGMENTATION OF HAND MOVEMENTS FOR HAND POSITIONS RECOGNITION IN FRENCH CUED SPEECH},
year = {2018} }
TY - EJOUR
T1 - AUTOMATIC TEMPORAL SEGMENTATION OF HAND MOVEMENTS FOR HAND POSITIONS RECOGNITION IN FRENCH CUED SPEECH
AU - LI LIU; GANG FENG; DENIS BEAUTEMPS
PY - 2018
PB - IEEE SigPort
UR - http://sigport.org/3072
ER -
LI LIU, GANG FENG, DENIS BEAUTEMPS. (2018). AUTOMATIC TEMPORAL SEGMENTATION OF HAND MOVEMENTS FOR HAND POSITIONS RECOGNITION IN FRENCH CUED SPEECH. IEEE SigPort. http://sigport.org/3072
LI LIU, GANG FENG, DENIS BEAUTEMPS, 2018. AUTOMATIC TEMPORAL SEGMENTATION OF HAND MOVEMENTS FOR HAND POSITIONS RECOGNITION IN FRENCH CUED SPEECH. Available at: http://sigport.org/3072.
LI LIU, GANG FENG, DENIS BEAUTEMPS. (2018). "AUTOMATIC TEMPORAL SEGMENTATION OF HAND MOVEMENTS FOR HAND POSITIONS RECOGNITION IN FRENCH CUED SPEECH." Web.
1. LI LIU, GANG FENG, DENIS BEAUTEMPS. AUTOMATIC TEMPORAL SEGMENTATION OF HAND MOVEMENTS FOR HAND POSITIONS RECOGNITION IN FRENCH CUED SPEECH [Internet]. IEEE SigPort; 2018. Available from : http://sigport.org/3072