Arun Baby

Arun Baby

Becoming Unlabelable

Context-based out-of-vocabulary word recovery for ASR systems in Indian languages

[arXiv] June 2022

Authors:

Arun Baby, Saranya Vinnaitherthan, Akhil Kerhalkar, Pranav Jawale, Sharath Adavanne, Nagaraj Adiga

Abstract:

Detecting and recovering out-of-vocabulary (OOV) words is always challenging for Automatic Speech Recognition (ASR) systems. Many existing methods focus on modeling OOV words by modifying acoustic and language models and integrating context words cleverly into models. To train such complex models, we need a large amount of data with context words, additional training time, and increased model size. However, after getting the ASR transcription to recover context-based OOV words, the post-processing method has not been explored much. In this work, we propose a post-processing technique to improve the performance of context-based OOV recovery. We created an acoustically boosted language model with a sub-graph made at phone level with an OOV words list. We proposed two methods to determine a suitable cost function to retrieve the OOV words based on the context. The cost function is defined based on phonetic and acoustic knowledge for matching and recovering the correct context words in the decode. The effectiveness of the proposed cost function is evaluated at both word-level and sentence-level. The evaluation results show that this approach can recover an average of 50% context-based OOV words across multiple categories.

Cite:

@misc{https://doi.org/10.48550/arxiv.2206.04305,
  doi = {10.48550/ARXIV.2206.04305},
  
  url = {https://arxiv.org/abs/2206.04305},
  
  author = {Baby, Arun and Vinnaitherthan, Saranya and Kerhalkar, Akhil and Jawale, Pranav and Adavanne, Sharath and Adiga, Nagaraj},
  
  keywords = {Audio and Speech Processing (eess.AS), Computation and Language (cs.CL), Sound (cs.SD), FOS: Electrical engineering, electronic engineering, information engineering, FOS: Electrical engineering, electronic engineering, information engineering, FOS: Computer and information sciences, FOS: Computer and information sciences},
  
  title = {Context-based out-of-vocabulary word recovery for ASR systems in Indian languages},
  
  publisher = {arXiv},
  
  year = {2022},
  
  copyright = {arXiv.org perpetual, non-exclusive license}
}

arXiv

Code:

NA