all AI news
AutoShard: Automated Embedding Table Sharding for Recommender Systems. (arXiv:2208.06399v1 [cs.LG])
Aug. 15, 2022, 1:10 a.m. | Daochen Zha, Louis Feng, Bhargav Bhushanam, Dhruv Choudhary, Jade Nie, Yuandong Tian, Jay Chae, Yinbin Ma, Arun Kejariwal, Xia Hu
cs.LG updates on arXiv.org arxiv.org
Embedding learning is an important technique in deep recommendation models to
map categorical features to dense vectors. However, the embedding tables often
demand an extremely large number of parameters, which become the storage and
efficiency bottlenecks. Distributed training solutions have been adopted to
partition the embedding tables into multiple devices. However, the embedding
tables can easily lead to imbalances if not carefully partitioned. This is a
significant design challenge of distributed systems named embedding table
sharding, i.e., how we should …
More from arxiv.org / cs.LG updates on arXiv.org
Jobs in AI, ML, Big Data
Founding AI Engineer, Agents
@ Occam AI | New York
AI Engineer Intern, Agents
@ Occam AI | US
AI Research Scientist
@ Vara | Berlin, Germany and Remote
Data Architect
@ University of Texas at Austin | Austin, TX
Data ETL Engineer
@ University of Texas at Austin | Austin, TX
Machine Learning Engineer - Sr. Consultant level
@ Visa | Bellevue, WA, United States