Similarity, Compression and Local Steps: Three Pillars of Efficient Communications for Distributed Variational Inequalities

arXiv:2302.07615v2 Announce Type: replace-cross
Abstract: Variational inequalities are a broad and flexible class of problems that includes minimization, saddle point, and fixed point problems as special cases. Therefore, variational inequalities are used in various applications ranging from equilibrium search to adversarial learning. With the increasing size of data and models, today's instances demand parallel and distributed computing for real-world machine learning problems, most of which can be represented as variational inequalities. Meanwhile, most distributed approaches have a significant bottleneck - …

abstract adversarial adversarial learning applications arxiv cases class communications compression cs.dc cs.gt cs.lg distributed equilibrium math.oc search stat.ml type