[D] Gated Long-Term Memory

Today, I am presenting my latest idea: Gated Long-Term Memory

[GLTM unit](https://preview.redd.it/shyz8mc2p6wc1.png?width=1018&format=png&auto=webp&s=b52c514ce9db7ad09bce5180bb16d5b850c366dc)

Gated Long-Term Memory tries to implement an efficient LSTM alternative. Unlike LSTM, GLTM does all the heavy lifting in parallel, the only operations that are performed sequentially are the multiplication and addition operations. Gated Long-Term Memory uses only linear memory, compared to the quadratic memory of Transformers.

linear long-term lstm machinelearning memory operations presenting