[R] ML & NLP Reasearch Highlights of 2021 - by Sebastian Ruder

Web: https://www.reddit.com/r/LanguageTechnology/comments/sds8q8/r_ml_nlp_reasearch_highlights_of_2021_by/

ML and NLP Research Highlights of 2021 by Sebastian Ruder, actually research scientist at Google in London, ex-DeepMind: Universal Models, Massive Multi-task Learning, Beyond the Transformer (aka cross-attention), Prompting, Efficient Methods, Benchmarking, Conditional Image Generation, ML for Science, Code Synthesis, Bias, Retrieval Augmentation, Token-free Models, Temporal Adaptation, Importance of Data and Meta-learning.

2021 languagetechnology ml nlp