[NiteWave]

My question is, the 'wait' times all have a minimum 80ms, where as I tested another server running nginx and wait times are practically nil (single digits).

you can use http://www.webpagetest.org/ to test website's performance.
it should give much more detail than pingdom.
and everyone can access the test result once you provide the URL, so we can discuss about it easily.