Queuing dynamics of asynchronous Federated Learning

arXiv:2405.00017v1 Announce Type: cross
Abstract: We study asynchronous federated learning mechanisms with nodes having potentially different computational speeds. In such an environment, each node is allowed to work on models with potential delays and contribute to updates to the central server at its own pace. Existing analyses of such algorithms typically depend on intractable quantities such as the maximum node delay and do not consider the underlying queuing dynamics of the system. In this paper, we propose a non-uniform sampling …

abstract algorithms arxiv asynchronous computational cs.dc cs.lg dynamics environment federated learning node nodes server stat.ml study type updates work