[Discussion] Regarding Long Term Memory in NLP Models

Does anyone know if there exists a NLP model, like Lambda, that takes every conversation attempts to update their weights in order to incorporate it into its training?

My thought process would be instead of using attention and a subsection of the conversation to generate a response, it takes everything. Basically everything gets back propagated and adjusts the weights. This way the model might begin to "remember" its previous conversations. This may be a stretch and perhaps I am missing …

long term memory machinelearning memory nlp