There will be a hardware upgrade on monday during working hours (still trying to get the time). The site will be offline for up to an hour while the system gets transferred.
The upgrade should eliminate the capacity issues that have been showing every few days. I’ve limited the problem by reducing the number of simultaneous connections. This caused the system to stop swapping memory out while sending pages. However it will have reduced speed periodically during high demand.
This server side issue has been showing up since I started upgrades on the site. While the traffic per IP has reduced as a result of the upgrades, the total traffic has been increasing. This mainly seems to be from the multitudinous web-crawlers picking up every page in the site again.