Locally-Adaptive Quantization for Streaming Vector Search

Retrieving the most similar vector embeddings to a given query among a massive collection of vectors has long been a key component of countless real-world applications. The recently introduced Retrieval-Augmented Generation is one of the most prominent examples. For many of these applications, the database evolves over time by inserting new data and removing outdated data. In these cases, the retrieval problem is known as streaming similarity search. While Locally-Adaptive Vector Quantization (LVQ), a highly efficient vector compression method, yields …

applications collection cs.ir cs.lg data database embeddings examples key massive quantization query retrieval retrieval-augmented search streaming vector vector embeddings vectors vector search world