RAG vs Long Context Models [Discussion]

Hello everyone, I know that we all have seen the Gemini v1.5 model with 1 million context and also the hardware from company called groq showed that if the hardware is designed specifically for Language models in mind they can get much better. What do you think about RAG architectures now as we have seen very long context model. What if we have much more long context models with better quantization techniques and hardware?? Do you think architecture like RAGs …

architectures context gemini groq hardware hello language language models machinelearning mind rag think