Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
|
litespeed_wiki:cache:lscwp:configuration:crawler [2018/11/30 19:43] Lisa Clarke [Cookie Crawler] Added content |
litespeed_wiki:cache:lscwp:configuration:crawler [2019/12/10 15:08] Shivam Saluja WPML Addition to Crawler Section |
||
|---|---|---|---|
| Line 5: | Line 5: | ||
| [[https://blog.litespeedtech.com/2017/06/14/wpw-crawl-your-site-make-it-fly/|Learn more about crawling on our blog.]] | [[https://blog.litespeedtech.com/2017/06/14/wpw-crawl-your-site-make-it-fly/|Learn more about crawling on our blog.]] | ||
| - | {{:litespeed_wiki:cache:lscwp:lscwp-settings-crawler.png?direct&800|}} | + | {{:litespeed_wiki:cache:lscwp:lscwp-settings-crawler.png?nolink|}} |
| ===== Delay ===== | ===== Delay ===== | ||
| Line 80: | Line 80: | ||
| ===== Cookie Simulation ===== | ===== Cookie Simulation ===== | ||
| - | To crawl for a particular cookie, enter the cookie name, and the values you wish to crawl for. Values should be one per line, and can include a blank line. There will be one crawler created per cookie value, per simulated role. Press the + button to add additional cookies, but be aware the number of crawlers grows quickly with each new cookie. | + | To crawl for a particular cookie, enter the cookie name, and the values you wish to crawl for. Values should be one per line, and can include a blank line. There will be one crawler created per cookie value, per simulated role. Press the + button to add additional cookies, but be aware the number of crawlers grows quickly with each new cookie, and can be a drain on system resources. |
| For example, if you crawl for ''Guest'' and ''Administrator'' roles, and you add ''testcookie1'' with the values ''A'' and ''B'', you have 4 crawlers: | For example, if you crawl for ''Guest'' and ''Administrator'' roles, and you add ''testcookie1'' with the values ''A'' and ''B'', you have 4 crawlers: | ||
| Line 105: | Line 105: | ||
| There aren't many situations where you would need to simulate a cookie crawler, but it can be useful for sites that use a cookie to control multiple languages or currencies. | There aren't many situations where you would need to simulate a cookie crawler, but it can be useful for sites that use a cookie to control multiple languages or currencies. | ||
| + | |||
| + | In case of WPML, they use ''_icl_current_language=EN'' to differentiate users from the ones using a different language such as ''TH'' then their cookie changes to ''_icl_current_language=TH'', You can add them as Guests to crawl your website in all WPML Languages. | ||
| + | |||
| ===== Custom SiteMap ===== | ===== Custom SiteMap ===== | ||
| //Empty string// | //Empty string// | ||