Adapt the bin refill based on real usage

[deadalnix]

We need to go over the thread bins on a regular basis and, if the low water mark is high, flush some of the items in the bin and not refill as much next time. To the contrary, if the low water mark is at zero, and the bin has already been refilled, then we are consuming all we allocate and should increase the size of batches.