Web: http://arxiv.org/abs/2108.08842

June 16, 2022, 1:11 a.m. | Shay Vargaftik, Ran Ben Basat, Amit Portnoy, Gal Mendelson, Yaniv Ben-Itzhak, Michael Mitzenmacher

cs.LG updates on arXiv.org arxiv.org

Distributed Mean Estimation (DME) is a central building block in federated
learning, where clients send local gradients to a parameter server for
averaging and updating the model. Due to communication constraints, clients
often use lossy compression techniques to compress the gradients, resulting in
estimation inaccuracies.

DME is more challenging when clients have diverse network conditions, such as
constrained communication budgets and packet losses. In such settings, DME
techniques often incur a significant increase in the estimation error leading
to degraded …

arxiv communication distributed federated learning learning lg mean

More from arxiv.org / cs.LG updates on arXiv.org

Machine Learning Researcher - Saalfeld Lab

@ Howard Hughes Medical Institute - Chevy Chase, MD | Ashburn, Virginia

Project Director, Machine Learning in US Health

@ ideas42.org | Remote, US

Data Science Intern

@ NannyML | Remote

Machine Learning Engineer NLP/Speech

@ Play.ht | Remote

Research Scientist, 3D Reconstruction

@ Yembo | Remote, US

Clinical Assistant or Associate Professor of Management Science and Systems

@ University at Buffalo | Buffalo, NY