The Luong Attention Mechanism

The Luong attention sought to introduce several improvements over the Bahdanau model for neural machine translation, particularly by introducing two new classes of attentional mechanisms: a global approach that attends to all source words, and a local approach that only attends to a selected subset of words in predicting the target sentence.  In this tutorial, […]

The post The Luong Attention Mechanism appeared first on Machine Learning Mastery.

attention global attention local attention luong neural machine translation