Nov. 5, 2023, 3:41 p.m. | /u/AvvYaa

Machine Learning www.reddit.com

In this video from my YT channel, I explain 50 concepts that cover the basics of NLP like Tokenization and Word Embeddings, to seminal work like RNNs, Seq2Seq, Attention, to innovative Transformer models like BERT, GPT, XL-Net, and InstructGPT. I present the challenges we have faced in previous designs, and what the current architectures do to improve it, and upcoming challenges with Hallucination and Alignment. Sharing a link here for those interested.

attention basics bert challenges concepts embeddings explained gpt gpt4 instructgpt machinelearning nlp research seq2seq tokenization transformer transformer models video word word embeddings work

AI Research Scientist

@ Vara | Berlin, Germany and Remote

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne

Senior Machine Learning Engineer (MLOps)

@ Promaton | Remote, Europe

Business Data Analyst

@ Alstom | Johannesburg, GT, ZA