System Design: Load Balancer

Orchestrating strategies for optimal workload distribution in microservice applications

Introduction

Large distributed applications handle more than thousands of requests per second. At some point, it becomes evident that handling requests on a single machine is no longer possible. That is why software engineers care about horizontal scaling, where the whole system is consistently organized on multiple servers. In this configuration, every server handles only a portion of all requests, based on its capacity, performance, and several other factors.

Requests …

applications design distributed distributed applications distribution engineers getting-started load-balancing machine microservices multiple per requests scaling servers software software development software engineers strategies system-design-concepts