title: Language Identification in Short Utterances Using Long Short-Term Memory (LSTM) Recurrent Neural Networks.
abstract: Long Short Term Memory (LSTM) Recurrent Neural Networks (RNNs) have recently outperformed other state-of-the-art approaches, such as i-vector and Deep Neural Networks (DNNs), in automatic Language Identification (LID), particularly when dealing with very short utterances (∼3s). In this contribution we present an open-source, end-to-end, LSTM RNN system running on limited computational resources (a single GPU) that outperforms a reference i-vector system on a subset of the NIST Language Recognition Evaluation (8 target languages, 3s task) by up to a 26%. This result is in line with previously published research using proprietary LSTM implementations and huge computational resources, which made these former results hardly reproducible. Further, we extend those previous experiments modeling unseen languages (out of set, OOS, modeling), which is crucial in real applications. Results show that a LSTM RNN with OOS modeling is able to detect these languages and generalizes robustly to unseen OOS languages. Finally, we also analyze the effect of even more limited test data (from 2.25s to 0.1s) proving that with as little as 0.5s an accuracy of over 50% can be achieved.
authors.affiliation: ATVS-Biometric Recognition Group, Universidad Autonoma de Madrid, Madrid, Spain.
authors.forename: Ruben
authors.initials: R
authors.lastname: Zazo
authors.affiliation: ATVS-Biometric Recognition Group, Universidad Autonoma de Madrid, Madrid, Spain.
authors.forename: Alicia
authors.initials: A
authors.lastname: Lozano-Diez
authors.affiliation: ATVS-Biometric Recognition Group, Universidad Autonoma de Madrid, Madrid, Spain.
authors.forename: Javier
authors.initials: J
authors.lastname: Gonzalez-Dominguez
authors.affiliation: ATVS-Biometric Recognition Group, Universidad Autonoma de Madrid, Madrid, Spain.
authors.forename: Doroteo T
authors.initials: DT
authors.lastname: Toledano
authors.affiliation: ATVS-Biometric Recognition Group, Universidad Autonoma de Madrid, Madrid, Spain.
authors.forename: Joaquin
authors.initials: J
authors.lastname: Gonzalez-Rodriguez
mesh_terms: D000465:Algorithms; D007802:Language; D016571:Neural Networks, Computer
references.citation: Neural Comput. 2000 Oct;12(10):2451-71
references.pmid: 11032042
references.citation: Neural Netw. 2005 Jun-Jul;18(5-6):602-10
references.pmid: 16112549
references.citation: Neural Netw. 2015 Apr;64:49-58
references.pmid: 25242129
references.citation: IEEE Trans Neural Netw Learn Syst. 2017 Oct;28(10):2222-2232
references.pmid: 27411231