4.1.12 stops replying to requests

[andreas]

I made the mistake of trying to upgrade to 4.1.x from the awesome, perfect 4.0.20 release, and after a while the server stopped responding to request, at 0% CPU usage.

strace -tt -T -p 31579:

10:51:58.847925 epoll_wait(6, {}, 10, 100) = 0 <0.096000>
10:51:58.943970 gettimeofday({1339231918, 943998}, NULL) = 0 <0.000022>
10:51:58.944051 recv(63, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000021>
10:51:58.944126 recv(100, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000019>
10:51:58.944190 recv(108, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000019>
10:51:58.944254 recv(114, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000018>
10:51:58.944318 recv(119, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000019>
10:51:58.944386 recv(191, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000015>
10:51:58.944440 recv(196, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000013>
10:51:58.944488 epoll_wait(6, {}, 10, 100) = 0 <0.105026>
10:51:59.049564 gettimeofday({1339231919, 49588}, NULL) = 0 <0.000013>
10:51:59.049621 getppid()               = 31577 <0.000013>
10:51:59.049678 stat64("/var/log/lsws/access.log", {st_mode=S_IFREG|0644, st_size=2698293, ...}) = 0 <0.000021>
10:51:59.049753 stat64("/var/log/lsws/error.log", {st_mode=S_IFREG|0644, st_size=428401, ...}) = 0 <0.000019>
10:51:59.049822 stat64("/var/log/lsws/stderr.log", {st_mode=S_IFREG|0644, st_size=7034639, ...}) = 0 <0.000019>
10:51:59.050005 open("/var/log/lsws/mikrocontroller.net/access.log", O_WRONLY|O_CREAT|O_APPEND|O_LARGEFILE, 0644) = 174 <0.000020>
10:51:59.050058 fstat64(174, {st_mode=S_IFREG|0644, st_size=7840136, ...}) = 0 <0.000008>
10:51:59.050095 fcntl64(174, F_SETFD, FD_CLOEXEC) = 0 <0.000008>
10:51:59.050125 fcntl64(174, 0xd /* F_??? */, 0xff824ea4) = 0 <0.000011>
10:51:59.050158 write(174, "87.221.90.128 - - [09/Jun/2012:1"..., 1403) = 1403 <0.000030>
10:51:59.050214 fcntl64(174, 0xd /* F_??? */, 0xff824ea4) = 0 <0.000010>
10:51:59.050245 close(174)              = 0 <0.000010>
10:51:59.050274 close(152)              = 0 <0.000010>
10:51:59.050308 open("/var/log/lsws/ruby-captcha/access.log", O_WRONLY|O_CREAT|O_APPEND|O_LARGEFILE, 0644) = 152 <0.000013>
10:51:59.050346 fstat64(152, {st_mode=S_IFREG|0644, st_size=2314876, ...}) = 0 <0.000006>
10:51:59.050379 fcntl64(152, F_SETFD, FD_CLOEXEC) = 0 <0.000007>
10:51:59.050404 fcntl64(152, 0xd /* F_??? */, 0xff824ea4) = 0 <0.000008>
10:51:59.050430 write(152, "107.20.111.59 - - [09/Jun/2012:1"..., 258) = 258 <0.000018>
10:51:59.050470 fcntl64(152, 0xd /* F_??? */, 0xff824ea4) = 0 <0.000008>
10:51:59.050500 close(152)              = 0 <0.000009>
10:51:59.050533 open("/tmp/lshttpd/.rtreport.tmp", O_WRONLY|O_CREAT|O_TRUNC|O_LARGEFILE, 0644) = 152 <0.000021>
10:51:59.050578 fstat64(152, {st_mode=S_IFREG|0644, st_size=0, ...}) = 0 <0.000009>
10:51:59.050614 fcntl64(152, F_SETFD, FD_CLOEXEC) = 0 <0.000006>
10:51:59.050643 time(NULL)              = 1339231919 <0.000006>
10:51:59.050700 kill(3214, SIG_0)       = -1 EPERM (Operation not permitted) <0.000009>
10:51:59.050738 kill(3479, SIG_0)       = -1 EPERM (Operation not permitted) <0.000007>
10:51:59.050765 kill(3482, SIG_0)       = -1 EPERM (Operation not permitted) <0.000007>
10:51:59.050796 kill(31618, SIG_0)      = 0 <0.000008>
10:51:59.050822 kill(31619, SIG_0)      = 0 <0.000008>
10:51:59.050848 kill(31685, SIG_0)      = 0 <0.000007>
10:51:59.050873 kill(31620, SIG_0)      = 0 <0.000007>
10:51:59.050899 kill(31614, SIG_0)      = 0 <0.000007>
10:51:59.050934 kill(31580, SIG_0)      = 0 <0.000007>
10:51:59.050962 kill(3425, SIG_0)       = -1 EPERM (Operation not permitted) <0.000008>
10:51:59.051032 write(152, "VERSION: LiteSpeed Web Server/St"..., 2543) = 2543 <0.000018>
10:51:59.051075 close(152)              = 0 <0.000035>
10:51:59.051133 rename("/tmp/lshttpd/.rtreport.tmp", "/tmp/lshttpd/.rtreport") = 0 <0.000024>
10:51:59.051190 recv(17, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000011>
10:51:59.051228 recv(18, "G", 1, MSG_PEEK) = 1 <0.000009>
10:51:59.051261 recv(22, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000008>
10:51:59.051294 recv(27, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000008>
10:51:59.051325 recv(32, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000009>
10:51:59.051358 recv(59, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000008>
10:51:59.051390 recv(64, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000008>
10:51:59.051422 recv(70, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000008>
10:51:59.051454 recv(82, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000008>
10:51:59.051495 recv(104, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000009>
10:51:59.051528 recv(106, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000009>
10:51:59.051561 recv(117, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000008>
10:51:59.051593 recv(121, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000009>
10:51:59.051624 recv(122, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000008>
10:51:59.051655 recv(127, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000008>
10:51:59.051686 recv(130, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000008>
10:51:59.051719 recv(140, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000008>
10:51:59.051750 recv(144, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000008>
10:51:59.051781 recv(145, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000008>
10:51:59.051813 recv(148, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000008>
10:51:59.051844 recv(158, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000008>
10:51:59.051876 recv(160, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000008>
10:51:59.051909 epoll_wait(6, {}, 10, 100) = 0 <0.092167>
10:51:59.144125 gettimeofday({1339231919, 144149}, NULL) = 0 <0.000018>
10:51:59.144199 recv(21, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000020>
10:51:59.144272 recv(57, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000019>
10:51:59.144336 recv(60, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000019>
10:51:59.144403 recv(76, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000015>
10:51:59.144462 recv(87, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000014>
10:51:59.144514 recv(94, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000013>
10:51:59.144563 recv(96, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000013>
10:51:59.144615 recv(109, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000013>
10:51:59.144665 recv(111, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000012>
10:51:59.144714 recv(113, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000013>
10:51:59.144765 recv(128, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000013>
10:51:59.144814 recv(129, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000013>
10:51:59.144864 recv(143, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000013>
10:51:59.144915 recv(157, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000012>
10:51:59.144965 recv(165, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000013>
10:51:59.145022 recv(173, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000015>
10:51:59.145080 recv(192, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000015>
10:51:59.145136 epoll_wait(6, {}, 10, 100) = 0 <0.098949>
10:51:59.244144 gettimeofday({1339231919, 244177}, NULL) = 0 <0.000017>
10:51:59.244227 recv(15, 0xff824f6f, 1, MSG_PEEK) = -1 EAGAIN (Resource temporarily unavailable) <0.000023>
...

Linux xxxxxxxxxxx 2.6.32-40-server #87-Ubuntu SMP Tue Mar 6 02:10:02 UTC 2012 x86_64 GNU/Linux

[mistwang]

Please try 4.1.13,

/usr/local/lsws/admin/misc/lsup.sh -v 4.1.13