Iterative Language Model Estimation: Efficient Data Structure & Algorithms

Despite the availability of better performing techniques, most language models are trained using popular toolkits that do not support perplexity optimization. In this work, we present an ef- ficient data structure and optimized algorithms specifically de- signed for iterative parameter tuning. With the resulting imple- mentation, we demonstrate the feasibility and effectiveness of such iterative techniques in language model estimation. Index Terms: language modeling, smoothing, interpolation