all AI news
LSTM Is Back! A Deep Implementation of the Decades-old Architecture Challenges ViTs on Long Sequence Modelling
Web: https://syncedreview.com/2022/05/10/lstm-is-back-a-deep-implementation-of-the-decades-old-architecture-challenges-vits-on-long-sequence-modelling/
Synced syncedreview.com
A research team from Rikkyo University and AnyTech Co., Ltd. examines the suitability of different inductive biases for computer vision and proposes Sequencer, an architectural alternative to ViTs that leverages long short-term memory (LSTM) rather than self-attention layers to achieve ViT-competitive performance on long sequence modelling.
The post LSTM Is Back! A Deep Implementation of the Decades-old Architecture Challenges ViTs on Long Sequence Modelling first appeared on Synced.
ai architecture artificial intelligence challenges computer vision & graphics deep deep-neural-networks implementation long sequence processing lstm machine learning machine learning & data science ml modelling on research technology