Google & Waterloo U Scales Generative Retrieval to Handle 8.8M Passages

In a new paper How Does Generative Retrieval Scale to Millions of Passages? a research team from Google Research and University of Waterloo performs the first empirical study of generative retrieval across various corpus scales, even scaling up to the entire MS MARCO passage ranking task that contains 8.8M passages, aiming to provide insights on scaling generative retrieval to millions of passages.

ai artificial intelligence deep-neural-networks generative generative retrieval google google research information-retrieval machine learning machine learning & data science ml paper ranking research research team retrieval scale scaling scaling up study team technology university university of waterloo