Ok, is it also good to increase the Memory soft and hard limits? It's set to 250M and 300M respectively. Process soft and hard limit is set to 100M and 150M.
I thought those are related to the 503 service unavailable errors. It's weird that with Apache, it would at least load the pages, albeit slow, won't display a 503 error.