Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
litespeed_wiki:cache:lscwp:configuration:enabling_the_crawler [2018/12/14 15:45]
Lisa Clarke [On a LiteSpeed Native environment] Proofreading
litespeed_wiki:cache:lscwp:configuration:enabling_the_crawler [2019/08/05 15:07] (current)
Jackson Zhang
Line 135: Line 135:
 ./build rewrite_confs ./build rewrite_confs
 </​code>​ </​code>​
 +
 +==== ''​CacheEngine -crawler''​ ====
 +Starting from LSWS 5.3.5 or later, in any situation, if you just want to ensure to disable crawler for apache virtual host, you can add ''​CacheEngine -crawler''​ to the Apache virtual host configuration.  ​
 +  ​
 +  <​IfModule LiteSpeed>​
 +  CacheEngine -crawler
 +  </​IfModule>​
 +
 +''​CacheEngine -crawler''​(this is supported in LSWS v5.3.5 and later) in 
 +
  
 ===== In a LiteSpeed Native Environment ===== ===== In a LiteSpeed Native Environment =====
 The cache crawler is enabled by default in a LSWS native environment. ​ The cache crawler is enabled by default in a LSWS native environment. ​
  
-To disable it at the Server Level, ​in the LSWS WebAdmin interface, navigate ​to **LSWS Admin > Configuration > Server > General > Apache Style Configurations**click **Edit**, and make sure it reads ''​CacheEngine -crawler''​(this is supported in LSWS v5.3.5 and later).+To disable it at the Server Level, ​you will need to use LSWS 5.4 and above versionsince there is a new **Cache Features** function added to control ​this.
  
-{{ :​litespeed_wiki:​cache:​lscwp:​configuration:​lsws-native-crawler-disable-1.png?800 |}} +In the LSWS WebAdmin interface, navigate to **LSWS Admin > Configuration > Server > Cache**In **Cache Features**, check ''​On'',​ uncheck ''​Crawler'',​ check ''​ESI'',​ and uncheck ''​Not Set''​.
-{{ :​litespeed_wiki:​cache:​lscwp:​configuration:​lsws-native-crawler-disable-2.png?800 |}}+
  
-To disable the cache crawler at the Virtual Host level, you can add ''​CacheEngine -crawler'' ​to the vhost-level **Apache-style Configurations**.+If ''​Not Set'' ​is checked, ​the other three values will be ignored and the default values will be used. (By default, all three are checked.)
  
-{{ :​litespeed_wiki:​cache:​lscwp:​configuration:​lsws-native-crawler-disable-vh-3.png?800 |}}+{{:​litespeed_wiki:​cache:​lscwp:​configuration:​disable-crawler-lsws-native-1.png?​600|}} 
 + 
 +To disable the cache crawler ​at the  LSWS native Virtual Host level, you can go to **LSWS Admin > Configuration > Virtual Host > VH Name > Cache >**, and set **Cache Features** in the same manner as above. If ''​Not Set''​ is checked, the other three values will be ignored and the server-level configuration will be inherited. 
 + 
 +Please note: Do not set **Enable LiteMage** to ''​On'',​ as this setting will also enable the crawler, even if ''​Crawler''​ is unchecked.  
 + 
 +{{:​litespeed_wiki:​cache:​lscwp:​configuration:​disable-crawler-lsws-native-vh-1.png?600|}}
  
 To add any of the optional server variables, navigate to **Server > External App** and add the variable(s) to the **Environment** setting, one per line. For example: To add any of the optional server variables, navigate to **Server > External App** and add the variable(s) to the **Environment** setting, one per line. For example:
Line 155: Line 170:
  
 {{:​litespeed_wiki:​cache:​lscwp:​configuration:​lscwp-admin-crawler.png?​600|}} {{:​litespeed_wiki:​cache:​lscwp:​configuration:​lscwp-admin-crawler.png?​600|}}
 +
 +===== Testing =====
 +LiteSpeed Web server cache engine will set environment varibles for ''​X-LSCACHE''​. You can always check Envirment Variables through phpinfo page to see if crawler is on or not. If the crawler is not there, then it has been disabled successfully. LSWS can only disable the LiteSpeed cache plugin or LiteSpeed crawler since such LiteSpeed crawlers will check ''​X_LSCACHE''​ environment variable. LSWS can not stop any third party crawler from working since they don't check ''​X_LSCACHE''​ to act accordingly.  ​
 +
 +  $_SERVER['​X-LSCACHE'​] on,​esi
 +
 +{{:​litespeed_wiki:​cache:​lscwp:​configuration:​disable-crawler-lsws-native-phpinfo-1.png?​600|}}  ​
 +
 +In the LiteSpeed cache for WordPress plugin, under **Settings > Crawler**, it should show **Crawler Cron** set to ''​Disable'',​ and 
 +
 +  Warning: The crawler feature is not enabled on the LiteSpeed server. Please consult your server admin.
 +
 +{{:​litespeed_wiki:​cache:​lscwp:​configuration:​disable-crawler-lsws-native-wp-plugin-cron-status-1.png?​800|}}
 +
  • Admin
  • Last modified: 2018/12/14 15:45
  • by Lisa Clarke