Spikes in Server Load

[cool_recep]

Every once in a while, server load tops to 60ish levels. Restarting LSWS or cleaning the cache solves the problem. At those moments, LiteSpeed Web Server Plugin for WHM also slows down.

• CentOS 6.9
• 2 CPU License
• PHP 5.6
• MySQL 5.7
• WHM 70

 

[Tishu]

Hello,

Can you tell us what are the top processes when your server load.

 

[cool_recep]

It is usually instances of main page and the forum pages. I'll post an SS when it happens again.

 

[cool_recep]

Pid Owner Priority CPU % Memory % Command
16687 (Trace) (Kill) technopa 0

 30.46 0.12 lsphp
16689 (Trace) (Kill) technopa 0

 28.93 0.09 lsphp
16682 (Trace) (Kill) technopa 0

 28.00 0.12 lsphp:/home/technopa/public_html/sosyal/css.php
16821 (Trace) (Kill) technopa 0

 27.72 0.08 lsphp:/home/technopa/public_html/index.php
16820 (Trace) (Kill) technopa 0

 26.79 0.13 lsphp:/home/technopa/public_html/index.php
16648 (Trace) (Kill) technopa 0

 26.70 0.18 lsphp:/home/technopa/public_html/index.php
16650 (Trace) (Kill) technopa 0

 21.41 0.17 lsphp:/technopa/public_html/wp-admin/admin-ajax.php
8094 (Trace) (Kill) mysql 0

 20.87

 12.48 /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --plugin-dir=/usr/lib64/mysql/plugin --user=mysql --log-error=42-189-85-185.ip.idealhosting.net.tr.err --open-files-limit=10000 --pid-file=/var/run/mysqld/mysqld.pid --socket=/var/lib/mysql/mysql.sock
16823 (Trace) (Kill) technopa 0

 19.80 0.06 lsphp:/home/technopa/public_html/sosyal/css.php
16688 (Trace) (Kill) technopa 0

 19.29 0.10 lsphp:/home/technopa/public_html/index.php
16822 (Trace) (Kill) technopa 0

 18.81 0.06 lsphp:/home/technopa/public_html/sosyal/index.php
16667 (Trace) (Kill) technopa 0

 17.67 0.05 lsphp
16624 (Trace) (Kill) technopa 0

 17.22 0.09 lsphp
16683 (Trace) (Kill) technopa 0

 16.00 0.06 lsphp
16814 (Trace) (Kill) technopa 0

 15.62 0.06 lsphp
16574 (Trace) (Kill) technopa 0

 15.18 0.06 lsphp
16684 (Trace) (Kill) technopa 0

 14.57 0.06 lsphp
16665 (Trace) (Kill) technopa 0

 14.33 0.05 lsphp:/home/technopa/public_html/sosyal/index.php
16623 (Trace) (Kill) technopa 0

 14.04 0.06 lsphp
16817 (Trace) (Kill) technopa 0

 12.39 0.06 lsphp
16664 (Trace) (Kill) technopa 0

 12.29 0.06 lsphp
16680 (Trace) (Kill) technopa 0

 12.02 0.06 lsphp
16573 (Trace) (Kill) technopa 0

 11.55 0.06 lsphp
16681 (Trace) (Kill) technopa 0

 11.50 0.05 lsphp
16625 (Trace) (Kill) technopa 0

 11.42 0.06 lsphp
16615 (Trace) (Kill) technopa 0

 10.66 0.07 lsphp
13149 (Trace) (Kill) nobody 0

 10.36

 0.65 litespeed (lshttpd)
16516 (Trace) (Kill) technopa 0

 9.99 0.08 lsphp
15879 (Trace) (Kill) elasticsearch 0

 9.13

 5.61 /usr/bin/java -Xms1g -Xmx1g -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -XX:+AlwaysPreTouch -Xss1m -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djna.nosys=true -XX:-OmitStackTraceInFastThrow -Dio.netty.noUnsafe=true -Dio.netty.noKeySetOptimization=true -Dio.netty.recycler.maxCapacityPerThread=0 -Dlog4j.shutdownHookEnabled=false -Dlog4j2.disable.jmx=true -Djava.io.tmpdir=/tmp/elasticsearch.vBjHSsGm -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/var/lib/elasticsearch -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintTenuringDistribution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/log/elasticsearch/gc.log -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=32 -XX:GCLogFileSize=64m -Des.path.home=/usr/share/elasticsearch -Des.path.conf=/etc/elasticsearch -cp /usr/share/elasticsearch/lib/* org.elasticsearch.bootstrap.Elasticsearch -p /var/run/elasticsearch/elasticsearch.pid -d
16666 (Trace) (Kill) technopa 0

 9.00 0.06 lsphp
16816 (Trace) (Kill) technopa 0

 8.66 0.05 lsphp:/home/technopa/public_html/sosyal/index.php
16564 (Trace) (Kill) technopa 0

 8.64 0.18 lsphp:/home/technopa/public_html/index.php
16481 (Trace) (Kill) technopa 0

 8.05 0.11 lsphp:/home/technopa/public_html/index.php
16819 (Trace) (Kill) technopa 0

 8.04 0.05 lsphp
16430 (Trace) (Kill) technopa 0

 7.08 0.07 lsphp
16815 (Trace) (Kill) technopa 0

 6.30 0.05 lsphp
15909 (Trace) (Kill) technopa 0

 6.21 0.11 lsphp:/home/technopa/public_html/index.php
16391 (Trace) (Kill) technopa 0

 6.00 0.08 lsphp:/home/technopa/public_html/sosyal/index.php
16264 (Trace) (Kill) technopa 0

 5.47 0.11 lsphp
16679 (Trace) (Kill) root 0

 5.44 0.14 xml-api - get_current_lts_expiration_status
16678 (Trace) (Kill) root 0

 5.37 0.14 xml-api - get_update_availability
16818 (Trace) (Kill) technopa 0

 5.31 0.05 lsphp:/home/technopa/public_html/sosyal/index.php
16205 (Trace) (Kill) technopa 0

 5.20 0.19 lsphp:/home/technopa/public_html/index.php
16265 (Trace) (Kill) technopa 0

 5.15 0.10 lsphp
16270 (Trace) (Kill) technopa 0

 5.01 0.08 lsphp
16082 (Trace) (Kill) technopa 0

 4.59 0.07 lsphp:/home/technopa/public_html/index.php
16150 (Trace) (Kill) technopa 0

 4.57 0.14 lsphp
16262 (Trace) (Kill) technopa 0

 4.54 0.10 lsphp:/home/technopa/public_html/sosyal/index.php
16563 (Trace) (Kill) technopa 0

 3.93 0.05 lsphp:/home/technopa/public_html/sosyal/index.php
16258 (Trace) (Kill) technopa 0

 3.92 0.07 lsphp
16697 (Trace) (Kill) root 0

 3.25 0.01 /usr/local/cpanel/3rdparty/bin/perl /usr/local/cpanel/scripts/MirrorSearch_pingtest httpupdate.cpanel.net 0.0833333333333333 5 80
16696 (Trace) (Kill) root 0

 3.01 0.01 /usr/local/cpanel/3rdparty/bin/perl /usr/local/cpanel/scripts/MirrorSearch_pingtest httpupdate.cpanel.net 0.0833333333333333 5 80
16527 (Trace) (Kill) technopa 0

 2.23 0.05 lsphp:/home/technopa/public_html/sosyal/index.php
16549 (Trace) (Kill) root 0

 1.33 0.01 dovecot/auth -w
16673 (Trace) (Kill) root 0

 0.75 0.07 whostmgrd - serving 94.54.192.113
16646 (Trace) (Kill) root 0

 0.66 0.07 whostmgrd - serving 94.54.192.113
16674 (Trace) (Kill) root 0 0.38 0.07 whostmgrd - serving 94.54.192.113
16677 (Trace) (Kill) root 0 0.38 0.06 whostmgrd - serving 94.54.192.113
13150 (Trace) (Kill) nobody 0 0.38 0.01 litespeed (lshttpd)
1906 (Trace) (Kill) root 0 0.32 0.00 [kondemand/1]
1905 (Trace) (Kill) root 0 0.31 0.00 [kondemand/0]
1907 (Trace) (Kill) root 0 0.31 0.00 [kondemand/2]
1908 (Trace) (Kill) root 0 0.30 0.00 [kondemand/3]
1909 (Trace) (Kill) root 0 0.30 0.00 [kondemand/4]
1910 (Trace) (Kill) root 0 0.30 0.00 [kondemand/5]
1911 (Trace) (Kill) root 0 0.29 0.00 [kondemand/6]
1912 (Trace) (Kill) root 0 0.28 0.00 [kondemand/7]
13161 (Trace) (Kill) technopa 0 0.27 0.05 lsphp

 

[Pong]

did you run top from command line? I did not see the overall load for it and did not see any load problem from the output you posted.

WordPress crawler may cause server load. you can try to disable them globally.
https://www.litespeedtech.com/suppo...ommon_installation:shared-enable-individually

 

[cool_recep]

Does this have anything to do with Search Engines? What's the purpose of the crawler?

 

[Michael A]

Hi cool_recep,

The crawler's purpose is to keep your cache warm by visiting your site's pages at set intervals. That way the crawler will get the initial slow page load from the backend for any expired/uncached pages instead of the first "real" visitor to that page.

Regards,
-Michael

 

[cool_recep]

This is still happenning. I am thinking about buying a support ticket...

 

[Tishu]

Hello again,
My advice is:
1. Update Litespeed to the latest version.
2. With commands like "top" "top -c" "htop" see what processes are load.
3. You can use command like "lsof +p <PID>" see from where the loading processes are loading.
4. If its php process - check logs (access and error) for that page.
5. If its mysql use "mysqladmin processlist" and mysql logs.
6. Check system logs too.

 

[cool_recep]

It is actually ElasticSearch that is ruining our server. I've now killed the process and created a thread on their github. Please also check the thread:

https://github.com/elastic/elasticsearch/issues/29317