[D] Sequence Modelling Technique

Let's say we have a time series problem where we are trying to use past information to predict future inputs. Like stock prices, or heart rates, or a language model that receives one word at a time.

In theory you would want each output at t to contain the maximum amount of predictive information about label t+1.

Let's say you attach a second network to this RNN, which tries to predict hidden state t+1 from hidden state t and add …

machinelearning modelling