Load Balancer

Every request has to go somewhere. How the balancer chooses decides how slow the slowest ones get.

Code

Algorithm

Traffic 180 req/s

p95 latency, last 40 s

Speed 0.25×