Master Thesis MSTR-2020-84

BibliographySerai, Dhiren Devinder: Quantization of automatic speech recognition networks.
University of Stuttgart, Faculty of Computer Science, Electrical Engineering, and Information Technology, Master Thesis No. 84 (2020).
60 pages, english.

Recently, end-to-end neural networks based speech recognition systems have received great interests in the speech community. Although these systems offer a wide range of advantages such as high performance, they often rely on a neural network with a large number of parameters, i.e. large memory footprint and large decoding time. The main goal of this thesis is investigation of quantized neural networks for end-to-end speech recognition systems. Different quantization methods like post training quantization, scalar quantization, iterative product quantization and quantization aware training are investigated in this thesis on ASR model. By doing so, the final system is 3.7 times smaller than the baseline system, faster in decoding with a speedup factor of 1.19 and with almost same level of recognition performance.

Full text and
other links
Department(s)University of Stuttgart, Institute for Natural Language Processing
Superviser(s)Vu, Prof. Ngoc Thang; Schweitzer, Dr. Antje; Denisov, Pavel
Entry dateJuly 27, 2021
   Publ. Computer Science