How can I stop the Baidu Spider using up my site resources?
Baidu is the most popular search engine in China. It can crawly your site twice as often as Google yet unless your site is in Mandarin, your site is unlikely to benefit from all that crawling.
If you have a busy forum or website with hundreds of pages you may find the the Baidu Spider starting to take up more of your site resources by indexing up to 90 pages every 15 minutes often leaving connections open or failing to close them properly.
You can easily disable the Baidu spider by placing the following in your .htaccess file:
BrowserMatchNoCase Baiduspider bad_bot Deny from env=bad_bot
Using this method saves you the trouble of having to find blocks of Baidu IP addresses and block them individually.
How do I block the Baiduspider from crawling my site? written by UKC average rating 1/5 - 1 user ratings