Using text embedding models and vector databases as text classifiers with the example of medical data

arXiv:2402.16886v1 Announce Type: cross
Abstract: The advent of Large Language Models (LLMs) is promising and has found application in numerous fields, but as it often is with the medical field, the bar is typically quite high [5]. In tandem with LLMs, vector embedding models and vector databases provide a robust way of expressing numerous modes of data that are easily digestible by typical machine learning models. Along with the ease of adding information, knowledge, and data to these vector databases, …

abstract application arxiv classifiers cs.ai cs.ir cs.lg data databases embedding embedding models example fields found language language models large language large language models llms medical medical data medical field text text embedding type vector vector databases