NeuralSearchX: Serving a Multi-billion-parameter Reranker for Multilingual Metasearch at a Low Cost. (arXiv:2210.14837v1 [cs.IR])

The widespread availability of search API's (both free and commercial) brings
the promise of increased coverage and quality of search results for metasearch
engines, while decreasing the maintenance costs of the crawling and indexing
infrastructures. However, merging strategies frequently comprise complex
pipelines that require careful tuning, which is often overlooked in the
literature. In this work, we describe NeuralSearchX, a metasearch engine based
on a multi-purpose large reranking model to merge results and highlight
sentences. Due to the homogeneity of …

arxiv cost low