all AI news
[D] Relative positional embedding and what's the advantage over absolute positional encoding
Jan. 15, 2024, 5:49 p.m. | /u/karun_kodes
Machine Learning www.reddit.com
All I could understand is how's it done with relative to each word. But I really couldn't think of the advantages over absolute one as the "Attention is all you need" also states that ""We chose this function because we hypothesized it would allow the model to easily learn to attend by *relative positions.." So what's the advantage relative positional encoding carries ?.*
And can …
advantages attention attention is all you need embedding encoding machinelearning positional encoding reading think word
More from www.reddit.com / Machine Learning
[D] software to design figures
15 hours ago |
www.reddit.com
[Discussion] Should I go to ICML and present my paper?
1 day, 8 hours ago |
www.reddit.com
Jobs in AI, ML, Big Data
AI Engineer Intern, Agents
@ Occam AI | US
AI Research Scientist
@ Vara | Berlin, Germany and Remote
Data Architect
@ University of Texas at Austin | Austin, TX
Data ETL Engineer
@ University of Texas at Austin | Austin, TX
Lead GNSS Data Scientist
@ Lurra Systems | Melbourne
Data Engineer - Takealot Group (Takealot.com | Superbalist.com | Mr D Food)
@ takealot.com | Cape Town