Autothrottle: A Practical Bi-Level Approach to Resource Management for SLO-Targeted Microservices

arXiv:2212.12180v5 Announce Type: replace-cross
Abstract: Achieving resource efficiency while preserving end-user experience is non-trivial for cloud application operators. As cloud applications progressively adopt microservices, resource managers are faced with two distinct levels of system behavior: end-to-end application latency and per-service resource usage. Translating between the two levels, however, is challenging because user requests traverse heterogeneous services that collectively (but unevenly) contribute to the end-to-end latency. We present Autothrottle, a bi-level resource management framework for microservices with latency SLOs (service-level objectives). …

abstract application applications arxiv behavior cloud cloud applications cs.dc cs.lg efficiency experience however latency management managers microservices operators per practical resource efficiency resource management service type usage