Fair. Our solution is to make sure a biased load balancer (like in TFA) isn't sending the workload towards a select few machines while others may be not be as over worked, in as simple way as possible.

We run load balancers in a fail open mode. As in, if every backend is excusing itself, then none are excused.

But as you point out, load balancing is a hairy beast unto itself.