[Resolved] crashes - segfault and some more jargon

MentaL · Aug 10, 2014

Code:

Aug 10 20:54:24 web kernel: lsphp5[28617]: segfault at 7fff40181ff8 ip 000000000047689f sp 00007fff40182000 error 6 in lsphp-5.4.31[400000+945000]
Aug 10 20:54:35 web abrt[28618]: Saved core dump of pid 28617 (/usr/local/lsws/fcgi-bin/lsphp-5.4.31) to /var/spool/abrt/ccpp-2014-08-10-20:54:24-28617 (1177825280 bytes)
Aug 10 20:54:35 web abrtd: Directory 'ccpp-2014-08-10-20:54:24-28617' creation detected
Aug 10 20:54:35 web abrtd: Executable '/usr/local/lsws/fcgi-bin/lsphp-5.4.31' doesn't belong to any package and ProcessUnpackaged is set to 'no'
Aug 10 20:54:35 web abrtd: 'post-create' on '/var/spool/abrt/ccpp-2014-08-10-20:54:24-28617' exited with 1
Aug 10 20:54:35 web abrtd: Deleting problem directory '/var/spool/abrt/ccpp-2014-08-10-20:54:24-28617'
Aug 10 20:54:36 web kernel: lsphp5[28624]: segfault at 7fff40181ff8 ip 000000000047689f sp 00007fff40182000 error 6 in lsphp-5.4.31[400000+945000]
Aug 10 20:54:36 web abrt[28633]: Not saving repeating crash in '/usr/local/lsws/fcgi-bin/lsphp-5.4.31'
Aug 10 20:55:09 web kernel: lsphp5[28671]: segfault at 7fff4019bee8 ip 00000000004768ad sp 00007fff4019be90 error 6 in lsphp-5.4.31[400000+945000]
Aug 10 20:55:14 web kernel: lsphp5[28683]: segfault at 7fff40183ff8 ip 0000000000476892 sp 00007fff40184000 error 6 in lsphp-5.4.31[400000+945000]
Aug 10 20:55:14 web abrt[28685]: Not saving repeating crash in '/usr/local/lsws/fcgi-bin/lsphp-5.4.31'
Aug 10 20:55:20 web abrt[28680]: Saved core dump of pid 28671 (/usr/local/lsws/fcgi-bin/lsphp-5.4.31) to /var/spool/abrt/ccpp-2014-08-10-20:55:09-28671 (1181057024 bytes)
Aug 10 20:55:20 web abrtd: Directory 'ccpp-2014-08-10-20:55:09-28671' creation detected
Aug 10 20:55:20 web abrtd: Executable '/usr/local/lsws/fcgi-bin/lsphp-5.4.31' doesn't belong to any package and ProcessUnpackaged is set to 'no'
Aug 10 20:55:20 web abrtd: 'post-create' on '/var/spool/abrt/ccpp-2014-08-10-20:55:09-28671' exited with 1
Aug 10 20:55:20 web abrtd: Deleting problem directory '/var/spool/abrt/ccpp-2014-08-10-20:55:09-28671'
Aug 10 20:55:36 web kernel: lsphp5[28745]: segfault at 7fff40181ff8 ip 000000000047689f sp 00007fff40182000 error 6 in lsphp-5.4.31[400000+945000]
Aug 10 20:55:45 web pure-ftpd: (?@127.0.0.1) [INFO] New connection from 127.0.0.1
Aug 10 20:55:45 web pure-ftpd: (?@127.0.0.1) [INFO] __cpanel__service__auth__ftpd__ThCbZoa0khCrTsCt58nmSLklamk5dESywi1p6X2BU8bKqtmXWx9PkAgtMHYAhc46 is now logged in
Aug 10 20:55:46 web pure-ftpd: (__cpanel__service__auth__ftpd__ThCbZoa0khCrTsCt58nmSLklamk5dESywi1p6X2BU8bKqtmXWx9PkAgtMHYAhc46@127.0.0.1) [INFO] Logout.
Aug 10 20:55:47 web abrtd: Directory 'ccpp-2014-08-10-20:55:36-28745' creation detected
Aug 10 20:55:47 web abrt[28746]: Saved core dump of pid 28745 (/usr/local/lsws/fcgi-bin/lsphp-5.4.31) to /var/spool/abrt/ccpp-2014-08-10-20:55:36-28745 (1173819392 bytes)
Aug 10 20:55:47 web abrtd: Executable '/usr/local/lsws/fcgi-bin/lsphp-5.4.31' doesn't belong to any package and ProcessUnpackaged is set to 'no'
Aug 10 20:55:47 web abrtd: 'post-create' on '/var/spool/abrt/ccpp-2014-08-10-20:55:36-28745' exited with 1
Aug 10 20:55:47 web abrtd: Deleting problem directory '/var/spool/abrt/ccpp-2014-08-10-20:55:36-28745'
Aug 10 20:56:13 web kernel: lsphp5[28785]: segfault at 7fff40185ff0 ip 0000000000476ae9 sp 00007fff40185ff0 error 6 in lsphp-5.4.31[400000+945000]
Aug 10 20:56:25 web abrt[28786]: Saved core dump of pid 28785 (/usr/local/lsws/fcgi-bin/lsphp-5.4.31) to /var/spool/abrt/ccpp-2014-08-10-20:56:13-28785 (1177018368 bytes)
Aug 10 20:56:25 web abrtd: Directory 'ccpp-2014-08-10-20:56:13-28785' creation detected
Aug 10 20:56:25 web abrtd: Executable '/usr/local/lsws/fcgi-bin/lsphp-5.4.31' doesn't belong to any package and ProcessUnpackaged is set to 'no'
Aug 10 20:56:25 web abrtd: 'post-create' on '/var/spool/abrt/ccpp-2014-08-10-20:56:13-28785' exited with 1
Aug 10 20:56:25 web abrtd: Deleting problem directory '/var/spool/abrt/ccpp-2014-08-10-20:56:13-28785'
Aug 10 20:57:16 web kernel: lsphp5[28893]: segfault at 7fff40181ff8 ip 000000000047689f sp 00007fff40182000 error 6 in lsphp-5.4.31[400000+945000]
Aug 10 20:57:28 web abrt[28896]: Saved core dump of pid 28893 (/usr/local/lsws/fcgi-bin/lsphp-5.4.31) to /var/spool/abrt/ccpp-2014-08-10-20:57:16-28893 (1180389376 bytes)
Aug 10 20:57:28 web abrtd: Directory 'ccpp-2014-08-10-20:57:16-28893' creation detected
Aug 10 20:57:28 web abrtd: Executable '/usr/local/lsws/fcgi-bin/lsphp-5.4.31' doesn't belong to any package and ProcessUnpackaged is set to 'no'
Aug 10 20:57:28 web abrtd: 'post-create' on '/var/spool/abrt/ccpp-2014-08-10-20:57:16-28893' exited with 1
Aug 10 20:57:28 web abrtd: Deleting problem directory '/var/spool/abrt/ccpp-2014-08-10-20:57:16-28893'
Aug 10 20:57:48 web kernel: lsphp5[28959]: segfault at 7fff40181ff8 ip 000000000047689f sp 00007fff40182000 error 6 in lsphp-5.4.31[400000+945000]
Aug 10 20:57:59 web abrtd: Directory 'ccpp-2014-08-10-20:57:48-28959' creation detected
Aug 10 20:57:59 web abrt[28960]: Saved core dump of pid 28959 (/usr/local/lsws/fcgi-bin/lsphp-5.4.31) to /var/spool/abrt/ccpp-2014-08-10-20:57:48-28959 (1177034752 bytes)
Aug 10 20:57:59 web abrtd: Executable '/usr/local/lsws/fcgi-bin/lsphp-5.4.31' doesn't belong to any package and ProcessUnpackaged is set to 'no'
Aug 10 20:57:59 web abrtd: 'post-create' on '/var/spool/abrt/ccpp-2014-08-10-20:57:48-28959' exited with 1
Aug 10 20:57:59 web abrtd: Deleting problem directory '/var/spool/abrt/ccpp-2014-08-10-20:57:48-28959'
Aug 10 20:58:06 web kernel: lsphp5[29023]: segfault at 7fff40185ff0 ip 0000000000476ae9 sp 00007fff40185ff0 error 6 in lsphp-5.4.31[400000+945000]
Aug 10 20:58:06 web abrt[29024]: Not saving repeating crash in '/usr/local/lsws/fcgi-bin/lsphp-5.4.31'
Aug 10 21:00:46 web pure-ftpd: (?@127.0.0.1) [INFO] New connection from 127.0.0.1
Aug 10 21:00:46 web pure-ftpd: (?@127.0.0.1) [INFO] __cpanel__service__auth__ftpd__Ue9dzBfhDh3f_0jqe75sSeUzKT9sRHerOqgjgIVTsDXKTBOYXza5zknNO4hvSu1d is now logged in
Aug 10 21:00:47 web pure-ftpd: (__cpanel__service__auth__ftpd__Ue9dzBfhDh3f_0jqe75sSeUzKT9sRHerOqgjgIVTsDXKTBOYXza5zknNO4hvSu1d@127.0.0.1) [INFO] Logout.
Aug 10 21:00:50 web kernel: lsphp5[29342]: segfault at 7fff40181ff8 ip 000000000047689f sp 00007fff40182000 error 6 in lsphp-5.4.31[400000+945000]
Aug 10 21:01:01 web abrtd: Directory 'ccpp-2014-08-10-21:00:50-29342' creation detected
Aug 10 21:01:01 web abrt[29344]: Saved core dump of pid 29342 (/usr/local/lsws/fcgi-bin/lsphp-5.4.31) to /var/spool/abrt/ccpp-2014-08-10-21:00:50-29342 (1175162880 bytes)
Aug 10 21:01:01 web abrtd: Executable '/usr/local/lsws/fcgi-bin/lsphp-5.4.31' doesn't belong to any package and ProcessUnpackaged is set to 'no'
Aug 10 21:01:01 web abrtd: 'post-create' on '/var/spool/abrt/ccpp-2014-08-10-21:00:50-29342' exited with 1
Aug 10 21:01:01 web abrtd: Deleting problem directory '/var/spool/abrt/ccpp-2014-08-10-21:00:50-29342'
Aug 10 21:01:09 web kernel: lsphp5[29373]: segfault at 7fff40183ff8 ip 0000000000476892 sp 00007fff40184000 error 6 in lsphp-5.4.31[400000+945000]
Aug 10 21:01:09 web abrt[29374]: Not saving repeating crash in '/usr/local/lsws/fcgi-bin/lsphp-5.4.31'
Aug 10 21:01:49 web kernel: lsphp5[29444]: segfault at 7fff40185ff0 ip 0000000000476ae9 sp 00007fff40185ff0 error 6 in lsphp-5.4.31[400000+945000]
Aug 10 21:02:01 web abrt[29446]: Saved core dump of pid 29444 (/usr/local/lsws/fcgi-bin/lsphp-5.4.31) to /var/spool/abrt/ccpp-2014-08-10-21:01:49-29444 (1174867968 bytes)
Aug 10 21:02:01 web abrtd: Directory 'ccpp-2014-08-10-21:01:49-29444' creation detected
Aug 10 21:02:01 web abrtd: Executable '/usr/local/lsws/fcgi-bin/lsphp-5.4.31' doesn't belong to any package and ProcessUnpackaged is set to 'no'
Aug 10 21:02:01 web abrtd: 'post-create' on '/var/spool/abrt/ccpp-2014-08-10-21:01:49-29444' exited with 1
Aug 10 21:02:01 web abrtd: Deleting problem directory '/var/spool/abrt/ccpp-2014-08-10-21:01:49-29444'
Aug 10 21:02:56 web kernel: lsphp5[29577]: segfault at 7fff40181ff8 ip 000000000047689f sp 00007fff40182000 error 6 in lsphp-5.4.31[400000+945000]
Aug 10 21:03:08 web abrtd: Directory 'ccpp-2014-08-10-21:02:56-29577' creation detected
Aug 10 21:03:08 web abrt[29579]: Saved core dump of pid 29577 (/usr/local/lsws/fcgi-bin/lsphp-5.4.31) to /var/spool/abrt/ccpp-2014-08-10-21:02:56-29577 (1177571328 bytes)
Aug 10 21:03:08 web abrtd: Executable '/usr/local/lsws/fcgi-bin/lsphp-5.4.31' doesn't belong to any package and ProcessUnpackaged is set to 'no'
Aug 10 21:03:08 web abrtd: 'post-create' on '/var/spool/abrt/ccpp-2014-08-10-21:02:56-29577' exited with 1
Aug 10 21:03:08 web abrtd: Deleting problem directory '/var/spool/abrt/ccpp-2014-08-10-21:02:56-29577'
Aug 10 21:03:09 web kernel: lsphp5[29589]: segfault at 7fff40183ff8 ip 0000000000476892 sp 00007fff40184000 error 6 in lsphp-5.4.31[400000+945000]
Aug 10 21:03:09 web abrt[29591]: Not saving repeating crash in '/usr/local/lsws/fcgi-bin/lsphp-5.4.31'

Any ideas?

MentaL · Aug 10, 2014

continued

Code:

Aug 10 21:03:31 web kernel: lsphp5[29602]: segfault at 7fff40181ff8 ip 000000000047689f sp 00007fff40182000 error 6 in lsphp-5.4.31[400000+945000]
Aug 10 21:03:31 web kernel: lsphp5[29661]: segfault at 7fff40184f48 ip 00000000004768ad sp 00007fff40184ef0 error 6 in lsphp-5.4.31[400000+945000]
Aug 10 21:03:31 web abrt[29702]: Not saving repeating crash in '/usr/local/lsws/fcgi-bin/lsphp-5.4.31'
Aug 10 21:03:32 web kernel: lsphp5[29666]: segfault at 7fff40181ff8 ip 000000000047689f sp 00007fff40182000 error 6 in lsphp-5.4.31[400000+945000]
Aug 10 21:03:32 web abrt[29703]: Not saving repeating crash in '/usr/local/lsws/fcgi-bin/lsphp-5.4.31'
Aug 10 21:03:32 web kernel: lsphp5[29621]: segfault at 7fff40183ff8 ip 0000000000476892 sp 00007fff40184000 error 6 in lsphp-5.4.31[400000+945000]
Aug 10 21:03:32 web abrt[29705]: Not saving repeating crash in '/usr/local/lsws/fcgi-bin/lsphp-5.4.31'
Aug 10 21:03:32 web kernel: lsphp5[29607]: segfault at 7fff40181ff8 ip 000000000047689f sp 00007fff40182000 error 6 in lsphp-5.4.31[400000+945000]
Aug 10 21:03:32 web abrt[29706]: Not saving repeating crash in '/usr/local/lsws/fcgi-bin/lsphp-5.4.31'
Aug 10 21:03:32 web kernel: lsphp5[29673]: segfault at 7fff40183ff8 ip 0000000000476892 sp 00007fff40184000 error 6 in lsphp-5.4.31[400000+945000]
Aug 10 21:03:32 web abrt[29707]: Not saving repeating crash in '/usr/local/lsws/fcgi-bin/lsphp-5.4.31'
Aug 10 21:03:33 web kernel: lsphp5[29605]: segfault at 7fff40185ff0 ip 0000000000476ae9 sp 00007fff40185ff0 error 6 in lsphp-5.4.31[400000+945000]
Aug 10 21:03:33 web abrt[29708]: Not saving repeating crash in '/usr/local/lsws/fcgi-bin/lsphp-5.4.31'
Aug 10 21:03:33 web kernel: lsphp5[29657]: segfault at 7fff40181ff8 ip 000000000047689f sp 00007fff40182000 error 6 in lsphp-5.4.31[400000+945000]
Aug 10 21:03:33 web kernel: lsphp5[29667]: segfault at 7fff40184f48 ip 00000000004768ad sp 00007fff40184ef0 error 6 in lsphp-5.4.31[400000+945000]
Aug 10 21:03:33 web abrt[29710]: Not saving repeating crash in '/usr/local/lsws/fcgi-bin/lsphp-5.4.31'
Aug 10 21:03:33 web abrt[29709]: Not saving repeating crash in '/usr/local/lsws/fcgi-bin/lsphp-5.4.31'
Aug 10 21:03:33 web abrt[29711]: Not saving repeating crash in '/usr/local/lsws/fcgi-bin/lsphp-5.4.31'
Aug 10 21:03:34 web abrt[29712]: Not saving repeating crash in '/usr/local/lsws/fcgi-bin/lsphp-5.4.31'
Aug 10 21:03:44 web abrt[29701]: Saved core dump of pid 29602 (/usr/local/lsws/fcgi-bin/lsphp-5.4.31) to /var/spool/abrt/ccpp-2014-08-10-21:03:31-29602 (1174695936 bytes)
Aug 10 21:03:44 web abrtd: Directory 'ccpp-2014-08-10-21:03:31-29602' creation detected
Aug 10 21:03:44 web abrtd: Executable '/usr/local/lsws/fcgi-bin/lsphp-5.4.31' doesn't belong to any package and ProcessUnpackaged is set to 'no'
Aug 10 21:03:44 web abrtd: 'post-create' on '/var/spool/abrt/ccpp-2014-08-10-21:03:31-29602' exited with 1
Aug 10 21:03:44 web abrtd: Deleting problem directory '/var/spool/abrt/ccpp-2014-08-10-21:03:31-29602'
Aug 10 21:03:44 web kernel: __ratelimit: 2 callbacks suppressed
Aug 10 21:03:44 web kernel: lsphp5[29723]: segfault at 7fff40183ff8 ip 0000000000476892 sp 00007fff40184000 error 6 in lsphp-5.4.31[400000+945000]
Aug 10 21:03:44 web abrt[29726]: Not saving repeating crash in '/usr/local/lsws/fcgi-bin/lsphp-5.4.31'
Aug 10 21:04:10 web kernel: lsphp5[29743]: segfault at 7fff40183ff8 ip 0000000000476892 sp 00007fff40184000 error 6 in lsphp-5.4.31[400000+945000]
Aug 10 21:04:10 web kernel: lsphp5[29744]: segfault at 7fff40185ff0 ip 0000000000476ae9 sp 00007fff40185ff0 error 6 in lsphp-5.4.31[400000+945000]
Aug 10 21:04:10 web abrt[29747]: Not saving repeating crash in '/usr/local/lsws/fcgi-bin/lsphp-5.4.31'
root@web [/var/log]#

MentaL · Aug 10, 2014

stderr.log

Code:

2014-08-10 21:05:25.026 [STDERR] Child process with pid: 29822 was killed by signal: 15, core dump: 0
2014-08-10 21:05:26.147 [STDERR] Child process with pid: 29894 was killed by signal: 9, core dump: 0
2014-08-10 21:06:07.680 [STDERR] Child process with pid: 29982 was killed by signal: 11, core dump: 128
2014-08-10 21:06:13.376 [STDERR] Child process with pid: 29994 was killed by signal: 11, core dump: 128
2014-08-10 21:06:32.030 [STDERR] Child process with pid: 29947 was killed by signal: 15, core dump: 0
2014-08-10 21:07:11.123 [STDERR] Child process with pid: 30086 was killed by signal: 11, core dump: 128
2014-08-10 21:07:56.760 [STDERR] Child process with pid: 30184 was killed by signal: 11, core dump: 128
2014-08-10 21:08:12.035 [STDERR] Child process with pid: 30087 was killed by signal: 15, core dump: 0
2014-08-10 21:08:13.027 [STDERR] Child process with pid: 30186 was killed by signal: 15, core dump: 0
2014-08-10 21:08:15.018 [STDERR] Child process with pid: 30229 was killed by signal: 15, core dump: 0
2014-08-10 21:08:16.009 [STDERR] Child process with pid: 30239 was killed by signal: 15, core dump: 0
2014-08-10 21:08:16.009 [STDERR] Child process with pid: 30241 was killed by signal: 15, core dump: 0
2014-08-10 21:08:18.013 [STDERR] Child process with pid: 30242 was killed by signal: 15, core dump: 0
2014-08-10 21:08:18.029 [STDERR] Child process with pid: 30088 was killed by signal: 15, core dump: 0
2014-08-10 21:08:19.044 [STDERR] Child process with pid: 30245 was killed by signal: 15, core dump: 0
2014-08-10 21:08:19.085 [STDERR] Child process with pid: 30247 was killed by signal: 15, core dump: 0
2014-08-10 21:08:19.154 [STDERR] Child process with pid: 30084 was killed by signal: 15, core dump: 0
2014-08-10 21:08:20.027 [STDERR] Child process with pid: 30251 was killed by signal: 15, core dump: 0
2014-08-10 21:08:20.031 [STDERR] Child process with pid: 30252 was killed by signal: 15, core dump: 0
2014-08-10 21:08:20.856 [STDERR] Child process with pid: 30269 was killed by signal: 11, core dump: 128
2014-08-10 21:08:20.869 [STDERR] Child process with pid: 30264 was killed by signal: 11, core dump: 128
2014-08-10 21:08:20.923 [STDERR] Child process with pid: 30271 was killed by signal: 11, core dump: 128
2014-08-10 21:08:21.323 [STDERR] Child process with pid: 30280 was killed by signal: 11, core dump: 128
2014-08-10 21:08:32.544 [STDERR] Child process with pid: 30232 was killed by signal: 11, core dump: 128
2014-08-10 21:09:34.775 [STDERR] Child process with pid: 30449 was killed by signal: 11, core dump: 128
2014-08-10 21:09:46.246 [STDERR] Child process with pid: 30447 was killed by signal: 11, core dump: 128

NiteWave · Aug 11, 2014

Code:

Aug 10 20:54:24 web kernel: lsphp5[28617]: segfault at 7fff40181ff8 ip 000000000047689f sp 00007fff40182000 error 6 in lsphp-5.4.31[400000+945000]
Aug 10 20:54:35 web abrt[28618]: Saved core dump of pid 28617 (/usr/local/lsws/fcgi-bin/lsphp-5.4.31) to /var/spool/abrt/ccpp-2014-08-10-20:54:24-28617 (1177825280 bytes)
Aug 10 20:54:35 web abrtd: Directory 'ccpp-2014-08-10-20:54:24-28617' creation detected
Aug 10 20:54:35 web abrtd: Executable '/usr/local/lsws/fcgi-bin/lsphp-5.4.31' doesn't belong to any package and ProcessUnpackaged is set to 'no'
Aug 10 20:54:35 web abrtd: 'post-create' on '/var/spool/abrt/ccpp-2014-08-10-20:54:24-28617' exited with 1
Aug 10 20:54:35 web abrtd: Deleting problem directory '/var/spool/abrt/ccpp-2014-08-10-20:54:24-28617'

Code:

Aug 10 20:54:24 web kernel: lsphp5[28617]: segfault at 7fff40181ff8 ip 000000000047689f sp 00007fff40182000 error 6 in lsphp-5.4.31[400000+945000]
Aug 10 20:54:35 web abrt[28618]: Saved core dump of pid 28617 (/usr/local/lsws/fcgi-bin/lsphp-5.4.31) to /var/spool/abrt/ccpp-2014-08-10-20:54:24-28617 (1177825280 bytes)
Aug 10 20:54:35 web abrtd: Directory 'ccpp-2014-08-10-20:54:24-28617' creation detected
Aug 10 20:54:35 web abrtd: Executable '/usr/local/lsws/fcgi-bin/lsphp-5.4.31' doesn't belong to any package and ProcessUnpackaged is set to 'no'
Aug 10 20:54:35 web abrtd: 'post-create' on '/var/spool/abrt/ccpp-2014-08-10-20:54:24-28617' exited with 1
Aug 10 20:54:35 web abrtd: Deleting problem directory '/var/spool/abrt/ccpp-2014-08-10-20:54:24-28617'

/usr/local/lsws/fcgi-bin/lsphp-5.4.31 may have problem.
is phpinfo.php ok ?
see if you can disable the php extensions one by one, and this error is gone.

MentaL · Aug 11, 2014

appears to be originating from xcache, hmm.

MentaL · Aug 11, 2014

switched to APC as a trial and still get the same error, highly odd. I'll investigate further.

MentaL · Aug 11, 2014

Code:

2014-08-11 19:52:25.056DEBUG[MMAP] Release mapped data at 0x7fcebbd81000
2014-08-11 19:52:25.056DEBUG[MMAP] Release mapped data at 0x7fcebbe7c000
2014-08-11 19:52:25.056DEBUG[MMAP] Release mapped data at 0x7fcebbc06000
2014-08-11 19:52:25.056DEBUG[MMAP] Release mapped data at 0x7fcebbc7b000
2014-08-11 19:52:25.056DEBUG[MMAP] Release mapped data at 0x7fcebbc4c000
2014-08-11 19:52:25.056DEBUG[MMAP] Release mapped data at 0x7fcebbde7000
2014-08-11 19:52:25.056DEBUG[MMAP] Release mapped data at 0x7fcebbe07000
2014-08-11 19:52:25.056DEBUG[MMAP] Release mapped data at 0x7fcebbeab000
2014-08-11 19:52:25.056DEBUG[MMAP] Release mapped data at 0x7fcebd407000
2014-08-11 19:52:25.056DEBUG[MMAP] Release mapped data at 0x7fcebbf43000
2014-08-11 19:52:25.056DEBUG[MMAP] Release mapped data at 0x7fcebbe36000
2014-08-11 19:52:25.056DEBUG[MMAP] Release mapped data at 0x7fcebd3d0000
2014-08-11 19:52:25.056DEBUG[MMAP] Release mapped data at 0x7fcebbe27000
2014-08-11 19:52:25.056DEBUG[MMAP] Release mapped data at 0x7fcebbe86000
2014-08-11 19:52:25.056DEBUG[MMAP] Release mapped data at 0x7fcebd41b000
2014-08-11 19:52:25.056DEBUG[MMAP] Release mapped data at 0x7fcebbc49000
2014-08-11 19:52:25.056DEBUG[MMAP] Release mapped data at 0x7fcebbe4e000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbec3000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbc0b000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbd0f000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbdcd000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbe40000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbbfc000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbd5c000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbe03000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbbee000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbe02000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbca9000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebd83e000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbbbc000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbce9000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbe01000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbcf6000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbead000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbe6c000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbcf3000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbd51000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbcd7000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbd1a000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbf03000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbd0d000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbd04000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebd3ef000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbe06000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbee5000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbec9000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbd88000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbe81000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbca8000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbd3a000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbcfd000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbd21000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbf06000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbe2a000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbbfd000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbce3000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbde4000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbe0a000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbc28000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbcd5000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbde6000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbe35000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbe6d000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbd16000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbe94000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbbf8000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbf02000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbe9b000
2014-08-11 19:52:25.057DEBUG[MMAP] Release mapped data at 0x7fcebbd07000
2014-08-11 19:52:25.058DEBUG[MMAP] Release mapped data at 0x7fcebbcfc000
2014-08-11 19:52:25.058DEBUG[MMAP] Release mapped data at 0x7fcebbe37000
2014-08-11 19:52:25.058DEBUG[MMAP] Release mapped data at 0x7fcebbef1000
2014-08-11 19:52:25.058DEBUG[MMAP] Release mapped data at 0x7fcebbea7000
2014-08-11 19:52:25.058DEBUG[MMAP] Release mapped data at 0x7fcebd835000
2014-08-11 19:52:25.058DEBUG[MMAP] Release mapped data at 0x7fcebbe85000
2014-08-11 19:52:25.058DEBUG[MMAP] Release mapped data at 0x7fcebbca1000
2014-08-11 19:52:25.058DEBUG[MMAP] Release mapped data at 0x7fcebbe76000
2014-08-11 19:52:25.058DEBUG[MMAP] Release mapped data at 0x7fcebd82e000
2014-08-11 19:52:25.058DEBUG[MMAP] Release mapped data at 0x7fcebbe8e000
2014-08-11 19:52:25.058DEBUG[MMAP] Release mapped data at 0x7fcebbbb9000
2014-08-11 19:52:25.058DEBUG[MMAP] Release mapped data at 0x7fcebbd06000
2014-08-11 19:52:25.058DEBUG[MMAP] Release mapped data at 0x7fcebbcf2000
2014-08-11 19:52:25.058DEBUG[MMAP] Release mapped data at 0x7fcebbcf9000
2014-08-11 19:52:25.058DEBUG[MMAP] Release mapped data at 0x7fcebbd0b000
2014-08-11 19:52:25.058DEBUG[MMAP] Release mapped data at 0x7fcebd831000
2014-08-11 19:52:25.058DEBUG[MMAP] Release mapped data at 0x7fcebbe4d000
2014-08-11 19:52:25.058DEBUG[MMAP] Release mapped data at 0x7fcebbc6c000
2014-08-11 19:52:25.058DEBUG[MMAP] Release mapped data at 0x7fcebbd6a000
2014-08-11 19:52:25.058DEBUG[MMAP] Release mapped data at 0x7fcebbe87000
2014-08-11 19:52:25.058DEBUG[MMAP] Release mapped data at 0x7fcebbe68000
2014-08-11 19:52:25.058DEBUG[MMAP] Release mapped data at 0x7fcebbd09000

MentaL · Aug 11, 2014

Making random progress?

Downgraded xcache and got the following as it stands

Code:

Aug 11 22:09:35 web kernel: Pid 32183(lsphp5) over core_pipe_limit
Aug 11 22:09:35 web kernel: Skipping core dump
Aug 11 22:09:36 web kernel: Pid 32153(lsphp5) over core_pipe_limit
Aug 11 22:09:36 web kernel: Skipping core dump
Aug 11 22:09:36 web kernel: Pid 32178(lsphp5) over core_pipe_limit
Aug 11 22:09:36 web kernel: Skipping core dump
Aug 11 22:09:36 web kernel: Pid 32162(lsphp5) over core_pipe_limit
Aug 11 22:09:36 web kernel: Skipping core dump
Aug 11 22:09:36 web kernel: Pid 32161(lsphp5) over core_pipe_limit
Aug 11 22:09:36 web kernel: Skipping core dump
Aug 11 22:09:36 web kernel: Pid 32186(lsphp5) over core_pipe_limit
Aug 11 22:09:36 web kernel: Skipping core dump
Aug 11 22:09:37 web kernel: Pid 32204(lsphp5) over core_pipe_limit
Aug 11 22:09:37 web kernel: Skipping core dump
Aug 11 22:09:38 web kernel: Pid 32206(lsphp5) over core_pipe_limit
Aug 11 22:09:38 web kernel: Skipping core dump
Aug 11 22:09:44 web abrt[32200]: Saved core dump of pid 32194 (/usr/local/lsws/fcgi-bin/lsphp-5.4.31) to /var/spool/abrt/ccpp-2014-08-11-22:09:34-32194 (1174609920 bytes)
Aug 11 22:09:44 web abrt[32200]: /var/spool/abrt is 5848099248 bytes (more than 1279MiB), deleting 'ccpp-2014-08-11-21:28:52-15246'
Aug 11 22:09:45 web abrt[32200]: /var/spool/abrt is 4710964198 bytes (more than 1279MiB), deleting 'ccpp-2014-08-11-22:05:04-31695'
Aug 11 22:09:46 web abrt[32200]: /var/spool/abrt is 3533998230 bytes (more than 1279MiB), deleting 'ccpp-2014-08-11-22:08:04-32005'
Aug 11 22:10:14 web kernel: __ratelimit: 7 callbacks suppressed
Aug 11 22:10:14 web kernel: lsphp5[32142]: segfault at 7fff284e0ed8 ip 00000000004768ad sp 00007fff284e0e80 error 6 in lsphp-5.4.31[400000+945000]
Aug 11 22:10:14 web kernel: Pid 32142(lsphp5) over core_pipe_limit
Aug 11 22:10:14 web kernel: Skipping core dump
Aug 11 22:10:15 web kernel: lsphp5[32327]: segfault at 7fff284cfed8 ip 00000000004768ad sp 00007fff284cfe80 error 6 in lsphp-5.4.31[400000+945000]
Aug 11 22:10:15 web kernel: Pid 32327(lsphp5) over core_pipe_limit
Aug 11 22:10:15 web kernel: Skipping core dump

NiteWave · Aug 12, 2014

so lsphp-5.4.31 is ok, xcache or apc extension has the problem.
what's the xcache version, how did you build it, in WHM environment, the xcache configuration ?

MentaL · Aug 12, 2014

built through litespeed.

MentaL · Aug 13, 2014

I may have found the cause. I was using an OLD version of memcached built from an old RPM and never even knew! rebuilt the latest version manually, enabled xcache and thus far no errors.

Michael · Aug 13, 2014

Thanks for updating the forum on the solution.

Michael

MentaL · Aug 15, 2014

Hopefully it helps resolves someones error, especially if their installing from the latest centos distro (which has the old RPMs of memcached).

bobykus · Sep 10, 2014

Hello,

I have the same segfault issue . Would like to investigate it but dunno which version of php crashed. We rum 3 of it via suEXE daemons. Any way to get a core dump to see which exactly php is affected?

NiteWave · Sep 11, 2014

from the first post of this thread:

you can know lsphp-5.4.31 is used.

bobykus · Sep 11, 2014

Damn! Sorry, my bad, I forgot about details.
Actually, mine looks like

Code:

Sep 11 08:10:28 ws kernel: lsphp[7165]: segfault at 7fffe7c95fe8 ip 0000000000602f4a sp 00007fffe7c95fb0 error 6 in lsphp[400000+3e1000]

bobykus · Sep 11, 2014

I see [400000+3e1000] is constant - do you know what does it means?

NiteWave · Sep 17, 2014

it's memory address, no much valuable info in it.

do you still have the problem ? A staff mentioned me your post not answered yet, so I came back to follow up.

we received a similar report recently, the info is insufficient so not sure how to reply but we recommended
https://www.litespeedtech.com/support/wiki/doku.php/litespeed_wiki:php:503-errors
and then the user found the root cause himself -- duplicated php extension loaded.
so if the problem still there, can you follow the above guide to make some changes, to see if solve the issue.

bobykus · Sep 18, 2014

OK, do you know how to make php to do a core dump when segfault happens? I already rebuilt php, revised all and still getting crash.

bobykus · Sep 18, 2014

Seems to be in pcre

Code:

Sep 18 14:10:18 wsxx kernel: lsphp53[25830]: segfault at 7fff9de68fd0 ip 000000000048d86a sp 00007fff9de68fc0 error 6 in lsphp53[400000+a17000]

addr2line -e /usr/local/lsws/lsphp53/bin/lsphp  000000000048d86a
/usr/local/lsws/phpbuild/php-5.3.29/ext/pcre/pcrelib/pcre_exec.c:3011

Code:

Sep 18 14:10:18 wsxx kernel: lsphp53[25830]: segfault at 7fff9de68fd0 ip 000000000048d86a sp 00007fff9de68fc0 error 6 in lsphp53[400000+a17000]

addr2line -e /usr/local/lsws/lsphp53/bin/lsphp  000000000048d86a
/usr/local/lsws/phpbuild/php-5.3.29/ext/pcre/pcrelib/pcre_exec.c:3011

and error 6 means

ENXIO (No such device or address)

and the code is

RMATCH(eptr, ecode, offset_top, md, eptrb, RM19);

and the conclusion is - I dunno...

[Resolved] crashes - segfault and some more jargon

Well-Known Member

Well-Known Member

Well-Known Member

Administrator

Well-Known Member

Well-Known Member

Well-Known Member

Well-Known Member

Administrator

Well-Known Member

Well-Known Member

Well-Known Member

Well-Known Member

Well-Known Member

Administrator

Well-Known Member

Well-Known Member

Administrator

Well-Known Member

Well-Known Member