Communication-Efficient TeraByte-Scale Model Training Framework for Online Advertising. (arXiv:2201.05500v1 [cs.IR])

Click-Through Rate (CTR) prediction is a crucial component in the online
advertising industry. In order to produce a personalized CTR prediction, an
industry-level CTR prediction model commonly takes a high-dimensional (e.g.,
100 or 1000 billions of features) sparse vector (that is encoded from query
keywords, user portraits, etc.) as input. As a result, the model requires
Terabyte scale parameters to embed the high-dimensional input. Hierarchical
distributed GPU parameter server has been proposed to enable GPU with limited
memory to train …

advertising arxiv communication framework training