VDTuner: Automated Performance Tuning for Vector Data Management Systems

arXiv:2404.10413v1 Announce Type: cross
Abstract: Vector data management systems (VDMSs) have become an indispensable cornerstone in large-scale information retrieval and machine learning systems like large language models. To enhance the efficiency and flexibility of similarity search, VDMS exposes many tunable index parameters and system parameters for users to specify. However, due to the inherent characteristics of VDMS, automatic performance tuning for VDMS faces several critical challenges, which cannot be well addressed by the existing auto-tuning methods. In this paper, we …

arxiv automated cs.db cs.lg cs.pf data data management management performance performance tuning systems type vector