Differences

This shows you the differences between two versions of the page.

--- litespeed_wiki:cache:no-plugin-crawler [2019/04/17 14:27]
Jackson Zhang created
+++ litespeed_wiki:cache:no-plugin-crawler [2019/04/17 14:42]
Jackson Zhang [Can I setup crawler for rewrite rule based cache?]
@@ Line 2: / Line 2: @@
 You may wonder: "Can I setup crawler for rewrite ruble-based cache? Do you have such crawler solution for it if I have a sitemap for my customized application?
-Normally there is no need to setup crawler for rewrite rule based cache. The typical case for rewrite rule-based cache setup is to set cache for a very short time, such as 2 minutes. Then cache files will be expired and the site will need to re-cache again. The reason to set it to a very short time is to handle the cache purge. If you set it for a long time, any changes to that page won't be updated until the cache expired. 2 minutes could be a good timeframe meets your tolerate for the updated page not to be refreshed.  Of cause, you can set that cache TTL timeframe to be longer whichever you can are tolerant.
+Normally there is no need to setup crawler for rewrite rule based cache. The typical case for rewrite rule-based cache setup is to set cache for a very short time, such as 2 minutes. Then cache files will be expired and the site will need to re-cache again. The reason to set it to a very short time is to handle the cache purge. If you set it for a long time, any changes to cached page won't be updated until the cache expired. 2 minutes could be a good timeframe meets your tolerance for the updated page not to be refreshed.  Of cause, you can set that cache TTL timeframe to be longer whichever you can are tolerant.
 In some rare case, such as a user sets the cache TTL to 30 mins in the rewrite rules and still want the site to be crawled. The user has sitemap already for the site. How to enable crawler function within LSWS and is there any universal crawler script available? The answer is yes.