all AI news
[D]Can a transformer neural network learn to predict sequences longer than it saw?
June 28, 2022, 11:44 a.m. | /u/InternationalVisito
Machine Learning www.reddit.com
sequence **length=7**: input\[ 1, 3 ,5 ,6, 2, 4, 0\] - output\[ 1, 3 ,5 ,6, 2, 4, 0\]
sequence **length=3**: input\[ 5, 4 ,9 \] - output\[ 5, 4 ,9 \]
sequence **length=4**: input\[ 6, 3 ,9, 8 \] - output\[ 6, 3 ,9, 8 \]
...
Each integer(0-9) can be stored in embedding layer so we can pass it to transformer.
I …
More from www.reddit.com / Machine Learning
Jobs in AI, ML, Big Data
Senior ML Researcher - 3D Geometry Processing | 3D Shape Generation | 3D Mesh Data
@ Promaton | Europe
Cleared Senior Software Engineer, Computer Vision, Federal
@ CCRi | Chantilly, Virginia, United States
Data Analyst - B2C
@ DAZN | Hyderabad, India
Product Marketing Manager - AI Chatbot
@ SendBird | San Mateo, California, United States
Alternance Alternant Ingénieur Développement logiciel temps réel embarqué / computer vision (F/H)
@ Alstom | Villeurbanne, FR
AOT Data Analyst II - Highway Project Delivery
@ State of Vermont | Barre, VT, US