[solved] Give option robots.txt for each vhosts
I would like to suggest that if LiteSpeed have an option for robots.txt builtin as feature just like .htaccess
So we can adjust robots.txt for each vhosts without having one robots.txt reflects all vhosts.
We had 2 domains,
We only welcome the crawlers to crawls from domain A
We blocks crawlers to crawls domain B
Thank you and I hope I will find solution for my case and this suggestions makes LiteSpeed even perfect web server.
So, whether you eat or drink, or whatever you do, do all to the glory of God. (1 Corinthians 10:31 ESV)
Last edited by NiteWave; 05-27-2013 at 08:46 PM..