Need help for install Litemage Crawler for Magento 2

Discussion in 'LiteMage Cache Extension For Magento' started by Toni Moya, Sep 12, 2018.

  1. Toni Moya

    Toni Moya Member

  2. Pong

    Pong Well-Known Member Staff Member

  3. Toni Moya

    Toni Moya Member

    I´ve followed all the steps for the installation and is currently active, but there is no increase in the cached pages, the vast majority of pages respond with a: x-litespeed-cache: miss
     
  4. Pong

    Pong Well-Known Member Staff Member

    Please double check if the page URLs are in https://yourmain.com/sitemap.xml ?
     
    Last edited by a moderator: Sep 14, 2018
  5. Toni Moya

    Toni Moya Member

    Yes, you can check: https://www.salelsol.eu/sitemap.xml
     
    Last edited by a moderator: Sep 14, 2018
  6. Pong

    Pong Well-Known Member Staff Member

    what exact command did you run? Can you give an example URL which doesn't warm up?
    seem you site map url should be https://www.salelsol.eu/sitemap_001.xml
    sh M2-crawler.sh https://www.salelsol.eu/sitemap_001.xml
     
    Last edited by a moderator: Sep 14, 2018
  7. Unique_Eric

    Unique_Eric Administrator Staff Member

    Hi Toni,
    The script seems not crawl your sitemap, I will test it on my local site and update here shortly
    Best,
     
  8. Unique_Eric

    Unique_Eric Administrator Staff Member

    Hi Toni,
    I found out why your sitemap fail to crawl, because your sitemap has no line change. Not sure if it being minified by some optimize function?
    Could you tell us how your get this sitemap? and try not optimize this sitemap see if it works.
    Best,
    Eric
     
  9. Toni Moya

    Toni Moya Member

    - Hi Eric, many tanks for your help. Sitemap is created by an Mageworx app named: SEO Suite Ultimate Extension for Magento 2 what includes XML Sitemap.
    - I'm investigating what the problem may be.
    Best Regards
    Toni :)
     
  10. Unique_Eric

    Unique_Eric Administrator Staff Member

  11. Toni Moya

    Toni Moya Member

    - Hi Eirc, just created all new sitemap.xml by Magento2 build-in tool, please check now.

    Best Regards
    Toni
     
  12. Unique_Eric

    Unique_Eric Administrator Staff Member

    Checked, it's working.
    ./M2-crawler.sh [URL]https://www.salelsol.eu/sitemap.xml
    Prepare to crawl [URL]https://www.salelsol.eu/sitemap.xml XML file
    There are 313 urls in this site map
    Starting to run First view on desktop agent...
    https://www.salelsol.eu/acerca-salelsol.html -> Caching
    https://www.salelsol.eu/bolsademicrofibra.html -> Caching
    https://www.salelsol.eu/catalog/category/view/id/1796 -> Caching
    https://www.salelsol.eu/catalog/product/view/id/5845 -> No Need To Cache
    https://www.salelsol.eu/catalog/product/view/id/6116 -> No Need To Cache
    https://www.salelsol.eu/catalog/product/view/id/6117 -> No Need To Cache
    https://www.salelsol.eu/catalog/product/view/id/6125 -> No Need To Cache
    https://www.salelsol.eu/catalog/product/view/id/6136 -> No Need To Cache
    https://www.salelsol.eu/compras-seguras.html -> Caching
    https://www.salelsol.eu/d1-coal.html -> Caching
    https://www.salelsol.eu/d1-dense.html -> Caching
    https://www.salelsol.eu/d1-focus.html -> Caching

    You can try it and add it to cronjob

    Best,
    Eric
     
    Last edited by a moderator: Sep 17, 2018
  13. Toni Moya

    Toni Moya Member

    - Indeed Crawler is working but when I verify it using the browser developer tool, many pages already cached show up: cache miss.

    Best Regards
    Toni
     
  14. Unique_Eric

    Unique_Eric Administrator Staff Member

    Hi Toni,
    May I ask how you view the page? Did you view with guest view(non logged in)?
    You can try an incognito page and see if it works to you.
    Best,
    Eric
     

Share This Page