Sorry, you need to enable JavaScript to visit this website.

facebooktwittermailshare

CONTINUOUS ULTRASOUND BASED TONGUE MOVEMENT VIDEO SYNTHESIS FROM SPEECH

Abstract: 

The movement of tongue plays an important role in pronunciation. Visualizing the movement of tongue can improve speech intelligibility and also helps learning a second language. However, hardly any research has been investigated for this topic. In this paper, a framework to synthesize continuous ultrasound tongue movement video from speech is presented. Two different mapping methods are introduced as the most important parts of the framework. The objective evaluation and subjective opinions show that the Gaussian Mixture Model (GMM) based method has a better result for synthesizing static image and Vector Quantization (VQ) based method produces more stable continuous video. Meanwhile, the participants of evaluation state that the results of both methods are visual-understandable.

up
0 users have voted:

Paper Details

Authors:
Jianrong Wang; Yalong Yang, Jianguo Wei, Ju Zhang
Submitted On:
29 March 2016 - 10:25pm
Short Link:
Type:
Poster
Event:
Presenter's Name:
Ju Zhang
Paper Code:
IVMSP-P9.5
Document Year:
2016
Cite

Document Files

icassp-2016-ultrasound.pdf

(215 downloads)

Subscribe

[1] Jianrong Wang; Yalong Yang, Jianguo Wei, Ju Zhang, "CONTINUOUS ULTRASOUND BASED TONGUE MOVEMENT VIDEO SYNTHESIS FROM SPEECH", IEEE SigPort, 2016. [Online]. Available: http://sigport.org/1052. Accessed: Aug. 22, 2017.
@article{1052-16,
url = {http://sigport.org/1052},
author = {Jianrong Wang; Yalong Yang; Jianguo Wei; Ju Zhang },
publisher = {IEEE SigPort},
title = {CONTINUOUS ULTRASOUND BASED TONGUE MOVEMENT VIDEO SYNTHESIS FROM SPEECH},
year = {2016} }
TY - EJOUR
T1 - CONTINUOUS ULTRASOUND BASED TONGUE MOVEMENT VIDEO SYNTHESIS FROM SPEECH
AU - Jianrong Wang; Yalong Yang; Jianguo Wei; Ju Zhang
PY - 2016
PB - IEEE SigPort
UR - http://sigport.org/1052
ER -
Jianrong Wang; Yalong Yang, Jianguo Wei, Ju Zhang. (2016). CONTINUOUS ULTRASOUND BASED TONGUE MOVEMENT VIDEO SYNTHESIS FROM SPEECH. IEEE SigPort. http://sigport.org/1052
Jianrong Wang; Yalong Yang, Jianguo Wei, Ju Zhang, 2016. CONTINUOUS ULTRASOUND BASED TONGUE MOVEMENT VIDEO SYNTHESIS FROM SPEECH. Available at: http://sigport.org/1052.
Jianrong Wang; Yalong Yang, Jianguo Wei, Ju Zhang. (2016). "CONTINUOUS ULTRASOUND BASED TONGUE MOVEMENT VIDEO SYNTHESIS FROM SPEECH." Web.
1. Jianrong Wang; Yalong Yang, Jianguo Wei, Ju Zhang. CONTINUOUS ULTRASOUND BASED TONGUE MOVEMENT VIDEO SYNTHESIS FROM SPEECH [Internet]. IEEE SigPort; 2016. Available from : http://sigport.org/1052