Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision | Next revision Both sides next revision | ||
litespeed_wiki:cache:lscps:crawler [2018/07/27 15:53] Eric Leu [Crawl Interval] |
litespeed_wiki:cache:lscps:crawler [2018/07/27 15:53] Eric Leu [Crawl Interval] |
||
---|---|---|---|
Line 48: | Line 48: | ||
How often do we want to re-initiate the crawling process? This depends on how long it takes to crawl your site and what did you set for Public Cache TTL. \\ | How often do we want to re-initiate the crawling process? This depends on how long it takes to crawl your site and what did you set for Public Cache TTL. \\ | ||
Default TTL is one day(24hr). Maybe you can consider to run the script by cronjob every 12 hours.\\ | Default TTL is one day(24hr). Maybe you can consider to run the script by cronjob every 12 hours.\\ | ||
- | E.g. This will run twice a day, at 3:30am: ''30 3/15 * * * path_to_script/cachecrawler.sh SITE-MAP-URL -m -i 0.2'' | + | E.g. This will run twice a day, at 3:30am/15:30: ''30 3/15 * * * path_to_script/cachecrawler.sh SITE-MAP-URL -m -i 0.2'' |
Note: You can also use [[https://crontab.guru/|online crontab tool]] help you to verify time settings. | Note: You can also use [[https://crontab.guru/|online crontab tool]] help you to verify time settings. |