An HTTP load balancer can be configured to take URLs into account when deciding where to direct requests. Gathering URLs with a spider and feeding them to halberd will make it more likely that all servers will reply at some point. See 4.2.7.
