Sorry, you need to enable JavaScript to visit this website.

facebooktwittermailshare

Detecting Mismatch between Text Script and Voice-over Using Utterance Verification Based on Phoneme Recognition Ranking

Abstract: 

The purpose of this study is to detect the mismatch between text script and voice-over. For this, we present a novel utterance verification (UV) method, which calculates the degree of correspondence between a voice-over and the phoneme sequence of a script. We found that the phoneme recognition probabilities of exaggerated voice-overs decrease compared to ordinary utterances, but their rankings do not demonstrate any significant change. The proposed method, therefore, uses the recognition ranking of each phoneme segment corresponding to a phoneme sequence for measuring the confidence of a voice-over utterance for its corresponding script. The experimental results show that the proposed UV method outperforms a state-of-the-art approach using cross modal attention used for detecting mismatch between speech and transcription.

up
0 users have voted:

Paper Details

Authors:
Yoonjae Jeong, Hoon-Young Cho
Submitted On:
21 May 2020 - 7:57am
Short Link:
Type:
Presentation Slides
Event:
Presenter's Name:
Yoonjae Jeong
Paper Code:
HLT-P5.8
Document Year:
2020
Cite

Document Files

ICASSP2020_YJEONG_SLIDES.pdf

(24)

Subscribe

[1] Yoonjae Jeong, Hoon-Young Cho, "Detecting Mismatch between Text Script and Voice-over Using Utterance Verification Based on Phoneme Recognition Ranking", IEEE SigPort, 2020. [Online]. Available: http://sigport.org/5426. Accessed: Aug. 12, 2020.
@article{5426-20,
url = {http://sigport.org/5426},
author = {Yoonjae Jeong; Hoon-Young Cho },
publisher = {IEEE SigPort},
title = {Detecting Mismatch between Text Script and Voice-over Using Utterance Verification Based on Phoneme Recognition Ranking},
year = {2020} }
TY - EJOUR
T1 - Detecting Mismatch between Text Script and Voice-over Using Utterance Verification Based on Phoneme Recognition Ranking
AU - Yoonjae Jeong; Hoon-Young Cho
PY - 2020
PB - IEEE SigPort
UR - http://sigport.org/5426
ER -
Yoonjae Jeong, Hoon-Young Cho. (2020). Detecting Mismatch between Text Script and Voice-over Using Utterance Verification Based on Phoneme Recognition Ranking. IEEE SigPort. http://sigport.org/5426
Yoonjae Jeong, Hoon-Young Cho, 2020. Detecting Mismatch between Text Script and Voice-over Using Utterance Verification Based on Phoneme Recognition Ranking. Available at: http://sigport.org/5426.
Yoonjae Jeong, Hoon-Young Cho. (2020). "Detecting Mismatch between Text Script and Voice-over Using Utterance Verification Based on Phoneme Recognition Ranking." Web.
1. Yoonjae Jeong, Hoon-Young Cho. Detecting Mismatch between Text Script and Voice-over Using Utterance Verification Based on Phoneme Recognition Ranking [Internet]. IEEE SigPort; 2020. Available from : http://sigport.org/5426