Bullion: A Column Store for Machine Learning

arXiv:2404.08901v1 Announce Type: cross
Abstract: The past two decades have witnessed columnar storage revolutionizing data warehousing and analytics. However, the rapid growth of machine learning poses new challenges to this domain. This paper presents Bullion, a columnar storage system tailored for machine learning workloads. Bullion addresses the complexities of data compliance, optimizes the encoding of long sequence sparse features, efficiently manages wide-table projections, and introduces feature quantization in storage. By aligning with the evolving requirements of ML applications, Bullion extends …

abstract analytics arxiv challenges column complexities compliance cs.db cs.lg data data compliance data warehousing domain growth however machine machine learning paper storage store type workloads