not sure if the network "hiccup" issue --- to test, switch to apache, see if the response become fast at once ? if slow as well, then network's issue. if it becomes fast, can you post the graph(for apache) from host-tracker
also, are all websites slow or only particular website slow ? how about...