Differences

This shows you the differences between two versions of the page.

Link to this comparison view

litespeed_wiki:cache:litemage:troubleshooting:warming-cache-for-big-site [2018/01/09 19:03]
Jackson Zhang created
litespeed_wiki:cache:litemage:troubleshooting:warming-cache-for-big-site [2018/01/09 19:26]
Lisa Clarke Proofreading
Line 1: Line 1:
-====== How to setup LiteMage ​warmup ​for big site? ====== +====== How to Set up LiteMage ​Cache Warmup ​for a Big Site ====== 
-A Magento store is a very large site with 17k pages. You may have setup your LiteMage TTL to 86400, which is 24 hours, and your warmup internal set to 57600, which is 16hours. ​ You may have an issue whereby the entire website is being re-cached every 24 hours. This is resulting in the website running very slowly until the cache warmup ​is completeCrawling all 17k pages takes around 6-8 hours to complete. How to solve this problem?+Larger stores ​have special needs when it comes to cache warmup.
  
-For such as big site, you can adjust your settings based on your situation. How often do you products change? ​For example, if it does not change much, you can set your public TTL = 604800which is 1 week, and set up your warm-up interval to 345600, which is 4 days. So every 3 days it will try to recrawl ​again. You can also enable delta crawler, so when something ​change, the related URLs are automatically recrawled in 5 minutes.  ​+===== Example ===== 
 + 
 +Your Magento store is a very large site with 17k pages. LiteMage TTL is set to 86400 (24 hours), and the warmup interval is set to 57600 (16 hours). 
 +This results in the entire store being re-cached once-a-day via the crawler, which takes 6-8 hours to complete. 
 + 
 +This is a problem, because the website runs very slowly while it is being crawled. 
 + 
 +===== Solution ===== 
 + 
 +For such big site, you can adjust your settings based on your situation. How often do your products change? ​If they do not change much, then there is no need to have a TTL as short as 24 hours. Set your public TTL to something largerlike 604800 (1 week), and set your warm-up interval to 345600 ​(4 days)Every 3 days it will try to recrawl. You can also enable ​the delta crawler, so when something ​changes, the related URLs are automatically recrawled in 5 minutes.  ​
  
 When you flush all LiteMage cache files, the whole site warm-up will be automatically started. So it's safe to set a long TTL when you have delta crawler enabled. When you flush all LiteMage cache files, the whole site warm-up will be automatically started. So it's safe to set a long TTL when you have delta crawler enabled.
  
  
  • Admin
  • Last modified: 2018/01/09 19:26
  • by Lisa Clarke