So, for the web servers at work, we had disabled Apache's
KeepAlive settings due to possible denial of service. As part of some performance tuning I had turned it back on with a low timeout (4 seconds) to see how it held up. Here's the results:
The drop on the right is where KeepAlive was turned on. We did need to increase our MaxServers a bit for when load got high, but overall it's resulted in a huge speedup for the servers and less thrashing in general.