[D] LLMs are harming AI research

This is a bold claim, but I feel like LLM hype dying down is long overdue. Not only there has been relatively little progress done to LLM performance and design improvements after GPT4: the primary way to make it better is still just to make it bigger and all alternative architectures to transformer proved to be subpar and inferior, they drive attention (and investment) away from other, potentially more impactful technologies. This is in combination with influx of people without …

ai research architectures bigger bold claim design gpt4 hype improvements llm llm performance llms machinelearning performance progress research transformer