What's the best way to rate limit rather than block bots by user agents from within admin console ? i.e. bingbot/2.0 Baiduspider/2.0 BoardReader/1.0 omgilibot/0.4 Sogou web spider/4.0
