LSTM go_backwards() — Unravelling its ‘hidden’ secrets

go_backwards() — Unravelling its ‘hidden’ secrets

Understanding its hidden nuances & exploring its leaky nature!

Introduction

Long Short Term Memory (LSTM) are superior versions of Recurrent Neural Networks (RNN) and are capable of storing ‘context’, as the name suggests, over relatively long sequences. This allows them to be a perfect utility for NLP tasks such as document classification, speech recognition, Named Entity Recognition (NER), etc.

In many applications, such as …

bi-lstm elmo lstm next-word-prediction tensorflow transfer learning