Language modeling is key to many interesting problems such as speech recognition, machine translation, or image captioning.  The goal of the problem is to fit a probabilistic model which assigns probabilities to sentences. It does so by predicting next words in a text given a history of previous words.