Scalable Data Assimilation with Message Passing

arXiv:2404.12968v1 Announce Type: new
Abstract: Data assimilation is a core component of numerical weather prediction systems. The large quantity of data processed during assimilation requires the computation to be distributed across increasingly many compute nodes, yet existing approaches suffer from synchronisation overhead in this setting. In this paper, we exploit the formulation of data assimilation as a Bayesian inference problem and apply a message-passing algorithm to solve the spatial inference problem. Since message passing is inherently based on local computations, …

abstract arxiv computation compute core cs.dc cs.lg data distributed exploit nodes numerical numerical weather prediction paper prediction scalable stat.ap systems type weather weather prediction