Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
litespeed_wiki:cache:litemage2:crawler [2018/07/27 18:17] Lisa Clarke Proofreading |
litespeed_wiki:cache:litemage2:crawler [2019/04/04 15:56] Eric Leu [More Options] |
||
---|---|---|---|
Line 11: | Line 11: | ||
-[[https://www.litespeedtech.com/packages/litemage2.0/M2-crawler.sh | Download from here]] | -[[https://www.litespeedtech.com/packages/litemage2.0/M2-crawler.sh | Download from here]] | ||
- Change the permissions so that the file is executable: ''chmod +x M2_crawler.sh'' | - Change the permissions so that the file is executable: ''chmod +x M2_crawler.sh'' | ||
- | - Run the script: ''sh M2-crawler.sh SITE-MAP-URL'' | + | - Run the script: ''bash M2-crawler.sh SITE-MAP-URL'' |
==== More Options==== | ==== More Options==== | ||
- | * To get help: ''sh M2-crawler.sh -h'' | + | * To get help: ''bash M2-crawler.sh -h'' |
- | * To change default interval request from 0.1s to custom NUM value: ''sh M2-crawler.sh SITE-MAP-URL -i NUM'' | + | * To change default interval request from 0.1s to custom NUM value: ''bash M2-crawler.sh SITE-MAP-URL -i NUM'' |
+ | * To crawl with cookie set: ''bash M2-crawler.sh -c SITE-MAP-URL'' | ||
+ | * To store log in /tmp/M2-crawler.log: ''bash M2-crawler.sh -v SITE-MAP-URL'' | ||
+ | * To debug one URL and output on screen: ''bash M2-crawler.sh -d SITE-URL'' | ||
===== How to Generate a Sitemap===== | ===== How to Generate a Sitemap===== |