Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
litespeed_wiki:cache:lscwp:configuration:crawler [2018/03/15 19:29] Lisa Clarke [Role Simulation] added HTTP/2 Crawl |
litespeed_wiki:cache:lscwp:configuration:crawler [2019/12/10 19:42] Lisa Clarke [Cookie Simulation] Copyediting |
||
---|---|---|---|
Line 1: | Line 1: | ||
- | ====== LSCWP Configuration Settings: Crawler ====== | + | ====== LiteSpeed Cache for WordPress Settings: Crawler ====== |
The crawler must be enabled at the server-level or the virtual host level by a site admin. Please see: [[litespeed_wiki:cache:lscwp:configuration:enabling_the_crawler|Enabling the Crawler at the Server or Virtual Host Level]] | The crawler must be enabled at the server-level or the virtual host level by a site admin. Please see: [[litespeed_wiki:cache:lscwp:configuration:enabling_the_crawler|Enabling the Crawler at the Server or Virtual Host Level]] | ||
Line 5: | Line 5: | ||
[[https://blog.litespeedtech.com/2017/06/14/wpw-crawl-your-site-make-it-fly/|Learn more about crawling on our blog.]] | [[https://blog.litespeedtech.com/2017/06/14/wpw-crawl-your-site-make-it-fly/|Learn more about crawling on our blog.]] | ||
- | {{:litespeed_wiki:cache:lscwp:lscwp-settings-crawler.png?direct&800|}} | + | {{:litespeed_wiki:cache:lscwp:lscwp-settings-crawler.png?nolink|}} |
===== Delay ===== | ===== Delay ===== | ||
Line 79: | Line 79: | ||
**NOTE**: Only one crawler may run at a time, so if you have specified one or more user ids in the **Role Simulation** box, first the "Guest" crawler will run, and then the role-based crawlers will run, one after the other. | **NOTE**: Only one crawler may run at a time, so if you have specified one or more user ids in the **Role Simulation** box, first the "Guest" crawler will run, and then the role-based crawlers will run, one after the other. | ||
- | ===== HTTP/2 Crawl ===== | + | ===== Cookie Simulation ===== |
- | //ON// | + | To crawl for a particular cookie, enter the cookie name, and the values you wish to crawl for. Values should be one per line, and can include a blank line. There will be one crawler created per cookie value, per simulated role. Press the + button to add additional cookies, but be aware the number of crawlers grows quickly with each new cookie, and can be a drain on system resources. |
- | This setting, when enabled, forces pages to be crawled using the HTTP/2 protocol. | + | |
+ | For example, if you crawl for ''Guest'' and ''Administrator'' roles, and you add ''testcookie1'' with the values ''A'' and ''B'', you have 4 crawlers: | ||
+ | |||
+ | - Guest, testcookie1=A | ||
+ | - Guest, testcookie1=B | ||
+ | - Administrator, testcookie1=A | ||
+ | - Administrator, testcookie1=B | ||
+ | |||
+ | Add ''testcookie2'' with the values ''C'', ''D'', and <blank> and you suddenly have 12 crawlers. | ||
+ | |||
+ | - Guest, testcookie1=A, testcookie2=C | ||
+ | - Guest, testcookie1=B, testcookie2=C | ||
+ | - Administrator, testcookie1=A, testcookie2=C | ||
+ | - Administrator, testcookie1=B, testcookie2=C | ||
+ | - Guest, testcookie1=A, testcookie2=D | ||
+ | - Guest, testcookie1=B, testcookie2=D | ||
+ | - Administrator, testcookie1=A, testcookie2= | ||
+ | - Administrator, testcookie1=B, testcookie2= | ||
+ | - Guest, testcookie1=A, testcookie2= | ||
+ | - Guest, testcookie1=B, testcookie2= | ||
+ | - Administrator, testcookie1=A, testcookie2= | ||
+ | - Administrator, testcookie1=B, testcookie2= | ||
+ | |||
+ | There aren't many situations where you would need to simulate a cookie crawler, but it can be useful for sites that use a cookie to control multiple languages or currencies. | ||
+ | |||
+ | For example, WPML uses the ''_icl_current_language='' cookie to differentiate between visitor languages. An English speaker's cookie would look like ''_icl_current_language=EN'', while a Thai speaker's cookie would look like ''_icl_current_language=TH''. To crawl your site for a particular language, use a ''Guest'' user, and the appropriate cookie value. | ||
===== Custom SiteMap ===== | ===== Custom SiteMap ===== | ||
//Empty string// | //Empty string// |