Language Models for Sentence Completion

A practical application of a language model that picks the most likely candidate word that extends an English sentence by a single word

Co-authored with Naresh Singh.

Table of contents

Introduction
Problem Statement
Brainstorming a solution

• Algorithms and Data Structures
• NLP (Natural Language Processing)
• Deep Learning (Neural Networks)

An LSTM model

• Tokenization
• The PyTorch Model
• Using the model to prune invalid suggestions
• Computing the next word probability

A Transformer model

Conclusion

Introduction

Language …

application data deep learning english hands-on-tutorials language language model language models language processing llm lstm natural natural language natural language processing networks neural networks next-word-prediction practical processing pytorch singh table transformers word