Support

GOT · #1 05-05-2012, 07:37 AM

We just installed lsws on a cpanel server. Server really only runs one pretty busy and demanding site.

It runs pretty well for about an hour. After that, the web server stops responding. Server itself is fine, but lsws doesn't serve up pages.

I'm seeing this in the logs when it happens:

2012-05-04 22:38:43.016 [NOTICE] [125.24.76.192:28026-0#APVH_ewrestlingnews.com] No request delivery notification has been received from LSAPI process:20691, possible run away process.
2012-05-04 22:38:43.016 [NOTICE] [125.24.76.192:28026-0#APVH_ewrestlingnews.com] Retry with new instance.
2012-05-04 22:38:44.000 [INFO] [CLEANUP] Clean up child process with pid: 20691
2012-05-04 22:38:44.002 [NOTICE] [125.24.76.192:28067-0#APVH_ewrestlingnews.com] No request delivery notification has been received from LSAPI process:20694, possible run away process.
2012-05-04 22:38:44.002 [NOTICE] [125.24.76.192:28067-0#APVH_ewrestlingnews.com] Retry with new instance.
2012-05-04 22:38:44.002 [NOTICE] [24.214.104.164:45524-0#APVH_ewrestlingnews.com] No request delivery notification has been received from LSAPI process:20692, possible run away process.
2012-05-04 22:38:44.002 [NOTICE] [24.214.104.164:45524-0#APVH_ewrestlingnews.com] Retry with new instance.

There are only about 5 or 6 child lsphp5 processes and they are all handling a request when it dies.

I have another dedicated server without cpanel that runs an even busier site, but the problem I am seeing there is that in the lsws config area there aren't any virtualhosts listed. I presume this is because its pulling the virtual hosts from the apache config. I've changed the lsphp5 settings at the server level to match the ones of the dedicated server at the vhost level, but that doesn't seem to be having any effect.

Any help will be greatly appreciated.

NiteWave · #2 05-05-2012, 10:35 PM

those log messages are [NOTICE], not enough to identify the cause of the issue.

when stops responding, a restart help or not ?

taking the screenshot of real-time stats will be helpful as well.

GOT · #3 05-06-2012, 12:01 PM

I turned lsws back on and it took a few hours, but it did lock up again. Attached is the live data. Hopefully you can see something I am missing.

The processes are what are most interesting. This is the lsws process tree when it stopped responding:

7930 ? S< 0:00 litespeed (lshttpd)
7931 ? S< 0:00 \_ httpd (lscgid)
7977 ? S 0:34 | \_ admin_php
10656 ? S 0:00 | \_ lsphp5:/home/ewrestle/public_html/index.php
10671 ? S 0:00 | \_ lsphp5:/home/ewrestle/public_html/index.php
10700 ? S 0:00 | \_ lsphp5:/home/ewrestle/public_html/index.php
10704 ? S 0:00 | \_ lsphp5:/home/ewrestle/public_html/index.php
10706 ? S 0:00 | \_ lsphp5:/home/ewrestle/public_html/index.php
10709 ? S 0:00 | \_ lsphp5:/home/ewrestle/public_html/index.php
10711 ? S 0:00 | \_ lsphp5:/home/ewrestle/public_html/index.php
10713 ? S 0:00 | \_ lsphp5:/home/ewrestle/public_html/index.php
10717 ? S 0:00 | \_ lsphp5:/home/ewrestle/public_html/index.php
10746 ? S 0:00 | \_ lsphp5:/home/ewrestle/public_html/index.php
7932 ? S<l 1:44 \_ litespeed (lshttpd)

I did a graceful restart and that didn't fix the issue. It looks like i spawned new lsws processes because now they are doubled when I did that:

7930 ? S< 0:00 litespeed (lshttpd)
7932 ? S<l 1:44 \_ litespeed (lshttpd)
10800 ? S< 0:00 \_ lscgid
10827 ? S 0:01 \_ lsphp5:/home/ewrestle/public_html/index.php
10828 ? S 0:01 \_ lsphp5:/home/ewrestle/public_html/index.php
10829 ? S 0:02 \_ lsphp5:/home/ewrestle/public_html/index.php
10859 ? S 0:00 \_ lsphp5:/home/ewrestle/public_html/index.php
10860 ? S 0:00 \_ lsphp5:/home/ewrestle/public_html/index.php
10863 ? S 0:00 \_ admin_php
10870 ? S 0:01 \_ lsphp5:/home/ewrestle/public_html/index.php
10873 ? S 0:01 \_ lsphp5:/home/ewrestle/public_html/index.php
10879 ? S 0:00 \_ lsphp5:/home/ewrestle/public_html/index.php
10880 ? S 0:00 \_ lsphp5:/home/ewrestle/public_html/index.php
10881 ? S 0:02 \_ lsphp5:/home/ewrestle/public_html/index.php
10813 ? S< 0:00 litespeed (lshttpd)
10814 ? S< 0:00 \_ httpd (lscgid)
10818 ? S 0:01 | \_ lsphp5:/home/ewrestle/public_html/index.php
10819 ? S 0:02 | \_ lsphp5:/home/ewrestle/public_html/index.php
10820 ? S 0:02 | \_ lsphp5:/home/ewrestle/public_html/index.php
10822 ? S 0:01 | \_ lsphp5:/home/ewrestle/public_html/index.php
10823 ? S 0:00 | \_ lsphp5:/home/ewrestle/public_html/index.php
10825 ? S 0:02 | \_ lsphp5:/home/ewrestle/public_html/index.php
10866 ? S 0:01 | \_ lsphp5:/home/ewrestle/public_html/index.php
10868 ? S 0:02 | \_ lsphp5:/home/ewrestle/public_html/index.php
10869 ? S 0:01 | \_ lsphp5:/home/ewrestle/public_html/index.php
10876 ? S 0:00 | \_ lsphp5:/home/ewrestle/public_html/index.php
10815 ? S<l 0:00 \_ litespeed (lshttpd)

Site still not responding at this point, so I did

/etc/init.d/lsws stop

And the processes would not go away. I tried that a few times to no avail. I finally did a killall -9 litespeed and then started litespeed. And then I switched it back to apache.

NiteWave · #4 05-06-2012, 08:18 PM

can run "pstree -p|egrep litespeed|httpd|php" as well.

have you installed 4.1.11 on this server ? the only advice I can give out at present is that, try 4.1.11 and see if any difference.

GOT · #5 05-07-2012, 08:12 AM

Its running 4.1.12 actually. You're suggesting I downgrade it?

webizen · #6 05-07-2012, 11:17 AM

according to real-time stats, your server settings unable to handle traffic (big number in EAProc Wait column). Hence page not up but server is fine. You should adjust lsphp5 External App settings and/or suEXEC max connections if suEXEC is enabled.

Quote:

2012-05-04 22:38:44.002 [NOTICE] [125.24.76.192:28067-0#APVH_ewrestlingnews.com] No request delivery notification has been received from LSAPI process:20694, possible run away process.
2012-05-04 22:38:44.002 [NOTICE] [125.24.76.192:28067-0#APVH_ewrestlingnews.com] Retry with new instance.

Error above usually indicates php process crashed. check stderr.log (in same dir as error_log) and see if anything. also, make sure matching php was built so no php in lsws act the same way in Apache.

GOT · #7 05-07-2012, 12:13 PM

I have another dedicated server without cpanel that runs an even busier site, but the problem I am seeing there is that in the lsws config area there aren't any virtualhosts listed. I presume this is because its pulling the virtual hosts from the apache config. I've changed the lsphp5 settings at the server level to match the ones of the dedicated server at the vhost level, but that doesn't seem to be having any effect.

webizen · #8 05-07-2012, 03:57 PM

is your PHP suEXEC enabled or not? If so, what's Max Connections for that?

Admin CP => Configuration => Server => General =>
PHP suEXEC
PHP suEXEC Max Conn

GOT · #9 05-07-2012, 08:27 PM

This is set to yes and 10

webizen · #10 05-08-2012, 11:51 AM

bump "PHP suEXEC Max Conn" to 20 and see EAProc Wait column becomes zero in a few.