Using Deep Learning for Text-Generation of Wikipedia Articles

Using AWD-LSTMs for natural language models in fastai and Pytorch

Predicting the next word in a sequence is the task of a language model. A language model is a form of self-supervised learning. Unlike most deep learning tasks, language models don’t have the targets of the problem provided to them through manual labelling. Instead, the data themselves contain the required labels. In our case, these labels are simply the next word in the …

articles deep-dives deep learning learning nlp pytorch text text generation wikipedia