Sorry, you need to enable JavaScript to visit this website.

Exploiting noisy web data by OOV ranking for low-resource keyword search

Citation Author(s):
Ji Wu
Submitted by:
Zhipeng Chen
Last updated:
15 October 2016 - 7:55am
Document Type:
Document Year:
Zhipeng Chen
Paper Code:


Spoken keyword search in low-resource condition suffers from out-of-vocabulary (OOV) problem and insufficient text data for language model (LM) training. Web-crawled text data is used to expand vocabulary and to augment language model. However, the mismatching between web text and the target speech data brings difficulties to effective utilization. New words from web data need an evaluation to exclude noisy words or introduce proper probabilities. In this paper, several criteria to rank new words from web data are investigated and are used as features
for logistic regression. In the IV keyword case, top N words are selected to expand the vocabulary. In the OOV keyword case, all words are used for expansion but unigram probabilities are re-assigned by Zipf’s law. On Swahili keyword search, after further text filtering and LM interpolation, this strategy is observed to outperform a strong and commonly used baseline method for data selection.

0 users have voted: