Sorry, you need to enable JavaScript to visit this website.

facebooktwittermailshare

Realizing Speech to Gesture Conversion by Keyword Spotting

Abstract: 

The paper proposed a method to realize a speech-to-gesture conversion for communication between normal and speech-impaired people. Keyword spotting was employed to recognize the keywords from input speech signals. At the same time, the three dimensional gesture models of keywords were built by 3D modeling technology according to the "Chinese sign language". The speech-to-gesture conversion was finally realized by playing the corresponding 3D gestures with OpenGL from the results of keyword spotting. Tests show that the realized keyword spotting achieves 90.1% of average recognition rate on letters and numbers. The converted gestures obtain 4.4 of the mean opinion score. Therefore the proposed method can be applied to the communications between normal and speech-impaired people.

up
1 user has voted: na zhao

Paper Details

Authors:
Na Zhao, Hongwu Yang
Submitted On:
14 October 2016 - 9:54pm
Short Link:
Type:
Presentation Slides
Event:
Presenter's Name:
Na Zhao
Paper Code:
139
Document Year:
2016
Cite

Document Files

keyword spotting, gesture modeling, speech to gesture conversion

(67)

Subscribe

[1] Na Zhao, Hongwu Yang, "Realizing Speech to Gesture Conversion by Keyword Spotting", IEEE SigPort, 2016. [Online]. Available: http://sigport.org/1212. Accessed: Jul. 17, 2019.
@article{1212-16,
url = {http://sigport.org/1212},
author = {Na Zhao; Hongwu Yang },
publisher = {IEEE SigPort},
title = {Realizing Speech to Gesture Conversion by Keyword Spotting},
year = {2016} }
TY - EJOUR
T1 - Realizing Speech to Gesture Conversion by Keyword Spotting
AU - Na Zhao; Hongwu Yang
PY - 2016
PB - IEEE SigPort
UR - http://sigport.org/1212
ER -
Na Zhao, Hongwu Yang. (2016). Realizing Speech to Gesture Conversion by Keyword Spotting. IEEE SigPort. http://sigport.org/1212
Na Zhao, Hongwu Yang, 2016. Realizing Speech to Gesture Conversion by Keyword Spotting. Available at: http://sigport.org/1212.
Na Zhao, Hongwu Yang. (2016). "Realizing Speech to Gesture Conversion by Keyword Spotting." Web.
1. Na Zhao, Hongwu Yang. Realizing Speech to Gesture Conversion by Keyword Spotting [Internet]. IEEE SigPort; 2016. Available from : http://sigport.org/1212