If clearing the cache gave you good results, then I'm now suspicious about what is being put in your cache by TER that results in so much delay in reading through it?  Performance of a single website should not be a factor of your cache.  If cache is a culprit, all web sites would be impacted unless that single website is doing something really funky.