[R] Parallelizing RNN over its sequence length

I am really excited to share our newest work in deep learning: parallelizing RNN! [https://arxiv.org/abs/2309.12252](https://arxiv.org/abs/2309.12252)

RNN is thought to be non-parallelizable because of its inherent sequential nature: its state depends on its previous state. This makes training RNN for long sequence usually takes long time compared to other architecture classes (like CNN).

What we present is an algorithm based on Newton's method to evaluate and train RNN in parallel. In one of our experiment, we can achieve >1000x faster evaluation …

algorithm architecture cnn experiment machinelearning nature rnn state thought training