Sorry, you need to enable JavaScript to visit this website.

Detecting Mismatch between Text Script and Voice-over Using Utterance Verification Based on Phoneme Recognition Ranking

Citation Author(s):
Yoonjae Jeong, Hoon-Young Cho
Submitted by:
Yoonjae Jeong
Last updated:
21 May 2020 - 7:57am
Document Type:
Presentation Slides
Document Year:
2020
Event:
Presenters:
Yoonjae Jeong
Paper Code:
HLT-P5.8
 

The purpose of this study is to detect the mismatch between text script and voice-over. For this, we present a novel utterance verification (UV) method, which calculates the degree of correspondence between a voice-over and the phoneme sequence of a script. We found that the phoneme recognition probabilities of exaggerated voice-overs decrease compared to ordinary utterances, but their rankings do not demonstrate any significant change. The proposed method, therefore, uses the recognition ranking of each phoneme segment corresponding to a phoneme sequence for measuring the confidence of a voice-over utterance for its corresponding script. The experimental results show that the proposed UV method outperforms a state-of-the-art approach using cross modal attention used for detecting mismatch between speech and transcription.

up
0 users have voted: