Arctic-Embed: Scalable, Efficient, and Accurate Text Embedding Models

arXiv:2405.05374v1 Announce Type: new
Abstract: This report describes the training dataset creation and recipe behind the family of \texttt{arctic-embed} text embedding models (a set of five models ranging from 22 to 334 million parameters with weights open-sourced under an Apache-2 license). At the time of their release, each model achieved state-of-the-art retrieval accuracy for models of their size on the MTEB Retrieval leaderboard, with the largest model, arctic-embed-l outperforming closed source embedding models such as Cohere's embed-v3 and Open AI's …

abstract apache arctic art arxiv cs.ai cs.cl cs.ir dataset embed embedding embedding models family five license parameters recipe release report retrieval scalable set state text text embedding training type