Why is Round Robin bad for 95th & 99th percentile
Apr 18, 2023
We see that round robin doesn’t perform well in the higher percentiles. How can it be that round robin has a great median, but bad 95th and 99th percentiles?
In round robin, the state of each server isn’t considered, so you’ll get quite a lot of requests going to servers that are idle. This is how we get the low 50th percentile. On the flip side, we’ll also happily send requests to servers that are overloaded, hence the bad 95th and 99th percentiles.
more here