Small Models, Big Insights: Leveraging Slim Proxy Models To Decide When and What to Retrieve for LLMs

arXiv:2402.12052v1 Announce Type: new
Abstract: The integration of large language models (LLMs) and search engines represents a significant evolution in knowledge acquisition methodologies. However, determining the knowledge that an LLM already possesses and the knowledge that requires the help of a search engine remains an unresolved issue. Most existing methods solve this problem through the results of preliminary answers or reasoning done by the LLM itself, but this incurs excessively high computational costs. This paper introduces a novel collaborative approach, …

abstract acquisition arxiv big cs.cl evolution insights integration knowledge knowledge acquisition language language models large language large language models llm llms search search engine small type