Microsoft & Xiamen U’s Progressive Distillation Method Sets New SOTA for Dense Retrieval

In the new paper Progressive Distillation for Dense Retrieval, a research team from Xiamen U and Microsoft Research presents PROD, a progressive distillation method for dense retrieval that achieves state-of-the-art performance on five widely used benchmarks.

ai artificial intelligence deep-neural-networks distillation information-retrieval knowledge-distillation machine learning machine learning & data science microsoft ml research retrieval sota technology