Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
litespeed_wiki:cache:litemage2:crawler [2018/07/27 18:17]
Lisa Clarke Proofreading
litespeed_wiki:cache:litemage2:crawler [2019/04/04 16:12]
Lisa Clarke [More Options]
Line 11: Line 11:
   -[[https://​www.litespeedtech.com/​packages/​litemage2.0/​M2-crawler.sh | Download from here]]   -[[https://​www.litespeedtech.com/​packages/​litemage2.0/​M2-crawler.sh | Download from here]]
   - Change the permissions so that the file is executable: ''​chmod +x M2_crawler.sh''​   - Change the permissions so that the file is executable: ''​chmod +x M2_crawler.sh''​
-  - Run the script: ''​sh M2-crawler.sh SITE-MAP-URL''​+  - Run the script: ''​bash M2-crawler.sh SITE-MAP-URL''​
  
 ==== More Options==== ==== More Options====
-  * To get help: ''​sh M2-crawler.sh -h''​ +  * To get help: ''​bash M2-crawler.sh -h''​ 
-  * To change default interval request from 0.1s to custom NUM value: ''​sh M2-crawler.sh SITE-MAP-URL -i NUM''​+  * To change default interval request from 0.1s to custom NUM value: ''​bash M2-crawler.sh SITE-MAP-URL -i NUM''​ 
 +  * To crawl with cookie set: ''​bash M2-crawler.sh -c SITE-MAP-URL''​ 
 +  * To store log in ''/​tmp/​M2-crawler.log'':​ ''​bash M2-crawler.sh -v SITE-MAP-URL''​ 
 +  * To debug one URL and output on screen: ''​bash M2-crawler.sh -d SITE-URL''​
  
 ===== How to Generate a Sitemap===== ===== How to Generate a Sitemap=====
  • Admin
  • Last modified: 2019/04/04 16:12
  • by Lisa Clarke