Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Last revision Both sides next revision
litespeed_wiki:cache:litemage2:crawler [2018/07/27 18:17]
Lisa Clarke Proofreading
litespeed_wiki:cache:litemage2:crawler [2019/04/04 15:56]
Eric Leu [More Options]
Line 11: Line 11:
   -[[https://​www.litespeedtech.com/​packages/​litemage2.0/​M2-crawler.sh | Download from here]]   -[[https://​www.litespeedtech.com/​packages/​litemage2.0/​M2-crawler.sh | Download from here]]
   - Change the permissions so that the file is executable: ''​chmod +x M2_crawler.sh''​   - Change the permissions so that the file is executable: ''​chmod +x M2_crawler.sh''​
-  - Run the script: ''​sh M2-crawler.sh SITE-MAP-URL''​+  - Run the script: ''​bash M2-crawler.sh SITE-MAP-URL''​
  
 ==== More Options==== ==== More Options====
-  * To get help: ''​sh M2-crawler.sh -h''​ +  * To get help: ''​bash M2-crawler.sh -h''​ 
-  * To change default interval request from 0.1s to custom NUM value: ''​sh M2-crawler.sh SITE-MAP-URL -i NUM''​+  * To change default interval request from 0.1s to custom NUM value: ''​bash M2-crawler.sh SITE-MAP-URL -i NUM''​ 
 +  * To crawl with cookie set: ''​bash M2-crawler.sh -c SITE-MAP-URL''​ 
 +  * To store log in /​tmp/​M2-crawler.log:​ ''​bash M2-crawler.sh -v SITE-MAP-URL''​ 
 +  * To debug one URL and output on screen: ''​bash M2-crawler.sh -d SITE-URL''​
  
 ===== How to Generate a Sitemap===== ===== How to Generate a Sitemap=====
  • Admin
  • Last modified: 2019/04/04 16:12
  • by Lisa Clarke