Multi-Query vs Multi-Head Attention

Learn all about the open-source libraries developed by Lightning AI, as their Staff Research Engineer, Sebastian Raschka, joins @JonKrohnLearns in this episode. He discusses his latest book, Machine Learning Q and AI, as well as how to exploit the greatest opportunities for LLM development, and what’s on the horizon for LLMs.

You can watch the full interview, “767: Open-Source LLM Libraries and Techniques — with Dr. Sebastian Raschka” here: https://www.superdatascience.com/767

attention book development engineer exploit head horizon joins learn libraries lightning lightning ai llm llm development llms machine machine learning multi-head multi-head attention opportunities query research staff