DASA: Delay-Adaptive Multi-Agent Stochastic Approximation

arXiv:2403.17247v1 Announce Type: cross
Abstract: We consider a setting in which $N$ agents aim to speedup a common Stochastic Approximation (SA) problem by acting in parallel and communicating with a central server. We assume that the up-link transmissions to the server are subject to asynchronous and potentially unbounded time-varying delays. To mitigate the effect of delays and stragglers while reaping the benefits of distributed computation, we propose \texttt{DASA}, a Delay-Adaptive algorithm for multi-agent Stochastic Approximation. We provide a finite-time analysis …

abstract acting agent agents aim approximation arxiv asynchronous cs.ai cs.ro cs.sy delay eess.sy math.oc multi-agent server stat.ml stochastic type