all AI news
[R] Notes & Video on DeepMind's RETRO Transformer Model
Jan. 15, 2022, 7:32 a.m. | /u/vackosar
Machine Learning www.reddit.com
Here are my bullet points with links and a video on RETRO Transformer. Although bit late, I think it may still be useful to post here.
Retrieval-Enhanced Language Model cross-attends trillions of tokens for SoTA on Wikitext103 and The Pile with 25x fewer parameters.
https://vaclavkosar.com/ml/DeepMinds-RETRO-Transformer-Model
submitted by /u/vackosar[link] [comments]
More from www.reddit.com / Machine Learning
Jobs in AI, ML, Big Data
Data Architect
@ University of Texas at Austin | Austin, TX
Data ETL Engineer
@ University of Texas at Austin | Austin, TX
Lead GNSS Data Scientist
@ Lurra Systems | Melbourne
Senior Machine Learning Engineer (MLOps)
@ Promaton | Remote, Europe
Senior Business Intelligence Developer / Analyst
@ Transamerica | Work From Home, USA
Data Analyst (All Levels)
@ Noblis | Bethesda, MD, United States