LSWS and cPanel 11.25 disaster

[ffeingol]

At lest on our servers there seems to be a major issue between LSWS and the 11.25 version of cPanel. cPanel is restarting LSWS as often as every 15 minutes. This is turning into a major issue. When cPanel issues these restarts (as many as 3 times in a very short time span) LSWS sometimes fails to restart. From what we can see in the logs it looks like the LSWS admin has not released the port and then the new one dies.

In digging through /usr/local/cpanel/logs/stats_log it looks like the cPanel log process is parsing for something and not liking what it finds. We see things like:


[Thu Jan 14 20:43:04 2010] [notice] Apache/#.#.# (Unix) configured -- resuming normal operations[2010-01-14 20:43:15 -0600] safeapacherestart exited with value 1
[2010-01-14 20:43:16 -0600] [sepxferlog]
[2010-01-14 20:43:16 -0600] [sepxferlog] complete
==> Loaded RRDs: version #.####
[2010-01-14 20:51:36 -0600] Processing bandwidth.
==> Loaded RRDs: version #.####
Apache restarted, but pid file does not match process list pids.


safeapacherestart is a binay, so we can't see what it's doing.

Any help / thoughts from the LSWS staff would be appreciated. Is anyone else running cPanel seeing similar things?

[mistwang]

Version of LSWS are you running?
Are you running LSWS parallel with Apache?

[ffeingol]

We're running the latest 3.x. So far we've resisted upgrading to 4.x because it simply did not seem stable. Yes, we are running Apache to handle SSI.

[ffeingol]

Is no one else having this issue (frequent restarts and LSWS failing to start sometimes) or has everyone else upgraded to 4.x? I'm really interested in hearing from others running LSWS and cPanel.

[Tony]

We run 4.x and also do not run cPanel 11.25 in fear of all the frequent restarts like you're experiencing.

[ffeingol]

Yea, we put the servers on manual update and watched the forums etc. for issues. Nothing popped up, so we upgraded. Then we found out about the issues :D

[mistwang]

We run 4.x and also do not run cPanel 11.25 in fear of all the frequent restarts like you're experiencing.
Tony, are you experiencing the same issue with 11.25 ? I thought it was because running Apache parallel to LiteSpeed.
The cPanel box in our lab is 11.25, does not show anything like what Frank posted.

[mistwang]

has everyone else upgraded to 4.x? I'm really interested in hearing from others running LSWS and cPanel.
90% of our cPanel users are using 4.x releases. 4.0.7-4.0.9 had some issues, it had been addressed long time ago.

[ffeingol]

mistwang,

In your lab are you on Release? Have you updated to 11.25? How many sites etc. are on the server. How often are stats/bandwidth set to run (funny that I'm asking you all these questions).

I'll compare our various boxes with LSWS and see if they are all having similar issues. I believe they all are, however, as we get a LSWS restarted message about every 15 minutes.

[anewday]

I haven't upgraded to 11.25 either because of this.

http://forums.cpanel.net/f5/11-25-current-apache-restarting-every-hour-134281.html

[ffeingol]

Yea, saw that too late. Prob. is it's not every hour, it's more like every 15 minutes.

[sux0r]

Im on cPanel 11.25.0-E42552 - WHM 11.25.0 -
The latest EDGE build and use Litespeed 4.0.12.

I dnt get crashes, but litespeed does restart a little bit often sumtimes.
Very few times do i see the uptime more than 1 hour.
As it restarts gracefully i dnt find it as a problem :)


EDIT:
These are the only things tht shows up regularly on the logs.

2010-01-16 22:25:52.399 ERROR [config] rewrite: unknown server variable while parsing: XML:/*
2010-01-16 22:25:52.400 WARN /usr/local/apache/conf/httpd.conf:127: Directive 'TypesConfig' is not allowed in current context.

[mistwang]

We fixed the TypesConfig issue and add tuned the Apache to LSWS adapter script a little in the updated 4.0.12 release package. You can login to LSWS admin console client "force reinstall" to update it under version management page.

[sux0r]

Tried to force an update from the admin console and got the error.

"Error: Failed to download release 4.0.12!"

~THanks :)

EDIT:
I found in error_log

2010-01-18 02:14:37.201 [NOTICE] [123.231.99.122:61375-3#_AdminVHost] [STDERR] PHP Warning: file_get_contents() [<a href='function.file-get-contents'>function.file-get-contents</a>]: URL file-access is disabled in the server configuration in /usr/local/lsws/admin/html.4.0.12/classes/ws/Service.php on line 537

2010-01-18 02:14:37.201 [NOTICE] [123.231.99.122:61375-3#_AdminVHost] [STDERR] PHP Warning: file_get_contents(http://download.litespeedtech.com/packages/latest/lsws-4.0.12-ent-i386-linux.tar.gz) [<a href='function.file-get-contents'>function.file-get-contents</a>]: failed to open stream: no suitable wrapper could be found in /usr/local/lsws/admin/html.4.0.12/classes/ws/Service.php on line 537

[mistwang]

Please edit /usr/local/lsws/admin/conf/php.ini, change allow_url_fopen to "On".

[sux0r]

Done tht, but still getting the error.

[mistwang]

after the change, you need to do "killall admin_php" to apply the change in php.ini .
If you need get it, you need to download and upgrade manually, should be addressed in the latest build.

[ffeingol]

So, if we installed 4.0.12 do we need to re-install? Just wan to be clear.

[mistwang]

yes, you need a manual upgrade again.

[DanEZPZ]

4.0.12 doesn't fix this. Any other suggestions? One server is getting hit hard with this.

[ffeingol]

@DanEZPZ,

What exactly are you getting hit hard with? A bit more details would help.

[DanEZPZ]

Litespeed restarts about every 10 minutes, sometimes it doesn't start up at all and needs to be done manually.

Also getting the following in the LSWS admin:

WARN /usr/local/apache/conf/httpd.conf:127: Directive 'TypesConfig' is not allowed in current context.

And the following in the stat_log

2010-01-23 09:30:15.493 [INFO] Stop listener 216.18.215.70:2080.
2010-01-23 09:30:15.493 [INFO] Stop listener 216.18.215.70:2443.
2010-01-23 09:30:15.493 [INFO] Stop listener *:7080.
2010-01-23 09:30:15.493 [NOTICE] [Child: 19742] Shut down successfully!
2010-01-23 09:30:15.503 [NOTICE] [AutoRestarter] cleanup children processes and unix sockets belong to process 19742 !
2010-01-23 09:30:15.603 [NOTICE] [AutoRestarter] child process with pid=19742 exited with status=0!
2010-01-23 09:30:15.603 [NOTICE] [PID:19740] Server Stopped!
[Sat Jan 23 09:30:15 2010] [alert] Child 19763 returned a Fatal error... Apache is exiting!
2010-01-23 09:30:16.102 [NOTICE] [AutoUpdate] Checking for new releases...
2010-01-23 09:30:16.115 [INFO] [AutoUpdate] No new update.
[Sat Jan 23 09:30:16 2010] [emerg] (22)Invalid argument: couldn't release the accept mutex[2010-01-23 09:30:22 -0800] safeapacherestart exited with value 1

[ffeingol]

Are you still running Apache and if so, why?

[DanEZPZ]

Strange, the admin panel was saying Apache wasn't running but after logging in via SSH I can see it is.

I've stopped it and will see if this solves the problem. Thanks ffeingol.

[ffeingol]

You may want to go to the LSWS plugin in WHM and make sure you are set for LSWS. If not, the next time things restart it will start Apache again. It's the combo of LSWS + Apache that appears to be causing the cPanel restart issues.