An evaluation of structured language modeling for automatic speech recognition

Johanna Bjorklund, Loek Cleophas, M. Karlsson

Research output: Contribution to journalArticleAcademicpeer-review

26 Downloads (Pure)

Abstract

We evaluated probabilistic lexicalized tree-insertion grammars (PLTIGs) on a classification task relevant for automatic speech recognition. The baseline is a family of n-gram models tuned with Witten-Bell smoothing. The language models are trained on unannotated corpora, consisting of 10,000 to 50,000 sentences collected from the English section of Wikipedia. For the evaluation, an additional 150 random sentences were selected from the same source, and for each of these, approximately 3,200 variations were generated. Each variant sentence was obtained by replacing an arbitrary word by a similar word, chosen to be at most 2 character edits from the original. The evaluation task consisted of identifying the original sentence among the automatically constructed (and typically inferior) alternatives. In the experiments, the n-gram models outperformed the PLTIG model on the smaller data set, but as the size of data grew, the PLTIG model gave comparable results. While PLTIGs are more demanding to train, they have the advantage that they assign a parse structure to their input sentences. This is valuable for continued algorithmic processing, for example, for summarization or sentiment analysis.
Original languageEnglish
Pages (from-to)1019-1034
Number of pages16
JournalJournal of Universal Computer Science
Volume23
Issue number11
DOIs
Publication statusPublished - 2017
Externally publishedYes

Keywords

  • Automatic speech recognition
  • Language modeling
  • Probabilistic lexicalized tree-insertion grammars

Cite this