Differences

This shows you the differences between two versions of the page.

--- litespeed_wiki:cache:lscwp:configuration:crawler [2018/03/15 19:29]
Lisa Clarke [Role Simulation] added HTTP/2 Crawl
+++ litespeed_wiki:cache:lscwp:configuration:crawler [2020/05/04 13:41]
Shivam Saluja
@@ Line 1: / Line 1: @@
-====== LSCWP Configuration Settings: Crawler ======
+====== LiteSpeed Cache for WordPress Settings: Crawler ======
+**Please Note**: This wiki is valid for v2.9.x and below of the LiteSpeed Cache Plugin for WordPress. If you are using v3.0 or above, please see [[https://docs.litespeedtech.com/lscache/lscwp/overview/|the new documentation]].
 The crawler must be enabled at the server-level or the virtual host level by a site admin. Please see: [[litespeed_wiki:cache:lscwp:configuration:enabling_the_crawler|Enabling the Crawler at the Server or Virtual Host Level]]
@@ Line 5: / Line 6: @@
 [[https://blog.litespeedtech.com/2017/06/14/wpw-crawl-your-site-make-it-fly/|Learn more about crawling on our blog.]]
-{{:litespeed_wiki:cache:lscwp:lscwp-settings-crawler.png?direct&800|}}
+{{:litespeed_wiki:cache:lscwp:lscwp-settings-crawler.png?nolink|}}
 ===== Delay =====
@@ Line 79: / Line 80: @@
 **NOTE**: Only one crawler may run at a time, so if you have specified one or more user ids in the **Role Simulation** box, first the "Guest" crawler will run, and then the role-based crawlers will run, one after the other.
-===== HTTP/2 Crawl =====
+===== Cookie Simulation =====
-//ON//
+To crawl for a particular cookie, enter the cookie name, and the values you wish to crawl for. Values should be one per line, and can include a blank line. There will be one crawler created per cookie value, per simulated role. Press the + button to add additional cookies, but be aware the number of crawlers grows quickly with each new cookie, and can be a drain on system resources.
-This setting, when enabled, forces pages to be crawled using the HTTP/2 protocol.
+For example, if you crawl for ''Guest'' and ''Administrator'' roles, and you add ''testcookie1'' with the values ''A'' and ''B'', you have 4 crawlers:
+  - Guest, testcookie1=A
+  - Guest, testcookie1=B
+  - Administrator, testcookie1=A
+  - Administrator, testcookie1=B
+Add ''testcookie2'' with the values ''C'', ''D'', and <blank> and you suddenly have 12 crawlers.
+  - Guest, testcookie1=A, testcookie2=C
+  - Guest, testcookie1=B, testcookie2=C
+  - Administrator, testcookie1=A, testcookie2=C
+  - Administrator, testcookie1=B, testcookie2=C
+  - Guest, testcookie1=A, testcookie2=D
+  - Guest, testcookie1=B, testcookie2=D
+  - Administrator, testcookie1=A, testcookie2=
+  - Administrator, testcookie1=B, testcookie2=
+  - Guest, testcookie1=A, testcookie2=
+  - Guest, testcookie1=B, testcookie2=
+  - Administrator, testcookie1=A, testcookie2=
+  - Administrator, testcookie1=B, testcookie2=
+There aren't many situations where you would need to simulate a cookie crawler, but it can be useful for sites that use a cookie to control multiple languages or currencies.
+For example, WPML uses the ''_icl_current_language='' cookie to differentiate between visitor languages. An English speaker's cookie would look like ''_icl_current_language=EN'', while a Thai speaker's cookie would look like ''_icl_current_language=TH''. To crawl your site for a particular language, use a ''Guest'' user, and the appropriate cookie value.
 ===== Custom SiteMap =====
 //Empty string//