{"id":943,"date":"2010-11-25T11:38:31","date_gmt":"2010-11-25T10:38:31","guid":{"rendered":"https:\/\/www.uk-cheapest.co.uk\/support\/?p=943"},"modified":"2011-12-09T14:44:29","modified_gmt":"2011-12-09T14:44:29","slug":"how-do-i-block-the-baiduspider-from-crawling-my-site","status":"publish","type":"post","link":"https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/","title":{"rendered":"How do I block the Baiduspider from crawling my site?"},"content":{"rendered":"<p><strong>How can I stop the Baidu Spider using up my site resources?<\/strong><\/p>\n<p>Baidu is the most popular search engine in China. It can crawly your site twice as often as Google yet unless your site is in Mandarin, your site is unlikely to benefit from all that crawling.<\/p>\n<p>If you have a busy forum or website with hundreds of pages you may find the the Baidu Spider starting to take up more of your site resources by indexing up to 90 pages every 15 minutes often leaving connections open or failing to close them properly.<\/p>\n<p>You can easily disable the Baidu spider by placing the following in your .htaccess file:<\/p>\n<pre>BrowserMatchNoCase Baiduspider bad_bot\r\nDeny from env=bad_bot<\/pre>\n<p>Using this method saves you the trouble of having to find blocks of Baidu IP addresses and block them individually.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>How can I stop the Baidu Spider using up my site resources? Baidu is the most popular search engine in China. It can crawly your site twice as often as Google yet unless your site is in Mandarin, your site is unlikely to benefit from all that crawling. If you have a busy forum or &#8230; <a title=\"How do I block the Baiduspider from crawling my site?\" class=\"read-more\" href=\"https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/\" aria-label=\"Read more about How do I block the Baiduspider from crawling my site?\">Read more&#8230;<\/a><\/p>\n","protected":false},"author":4,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"generate_page_header":"","footnotes":""},"categories":[61],"tags":[],"class_list":["post-943","post","type-post","status-publish","format-standard","hentry","category-support"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.6 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>How do I block the Baiduspider from crawling my site? - UK-Cheapest.co.uk<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How do I block the Baiduspider from crawling my site? - UK-Cheapest.co.uk\" \/>\n<meta property=\"og:description\" content=\"How can I stop the Baidu Spider using up my site resources? Baidu is the most popular search engine in China. It can crawly your site twice as often as Google yet unless your site is in Mandarin, your site is unlikely to benefit from all that crawling. If you have a busy forum or ... Read more...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/\" \/>\n<meta property=\"og:site_name\" content=\"UK-Cheapest.co.uk\" \/>\n<meta property=\"article:published_time\" content=\"2010-11-25T10:38:31+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2011-12-09T14:44:29+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.uk-cheapest.co.uk\/support\/wp-content\/uploads\/2023\/12\/IMG_3064.jpeg\" \/>\n\t<meta property=\"og:image:width\" content=\"768\" \/>\n\t<meta property=\"og:image:height\" content=\"439\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"UKC\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@ukchelpdesk\" \/>\n<meta name=\"twitter:site\" content=\"@ukchelpdesk\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"UKC\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/how-do-i-block-the-baiduspider-from-crawling-my-site\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/how-do-i-block-the-baiduspider-from-crawling-my-site\\\/\"},\"author\":{\"name\":\"UKC\",\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/#\\\/schema\\\/person\\\/135cf981b8a3a120603fcbc027eed746\"},\"headline\":\"How do I block the Baiduspider from crawling my site?\",\"datePublished\":\"2010-11-25T10:38:31+00:00\",\"dateModified\":\"2011-12-09T14:44:29+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/how-do-i-block-the-baiduspider-from-crawling-my-site\\\/\"},\"wordCount\":138,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/#organization\"},\"articleSection\":[\"Support\"],\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/how-do-i-block-the-baiduspider-from-crawling-my-site\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/how-do-i-block-the-baiduspider-from-crawling-my-site\\\/\",\"url\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/how-do-i-block-the-baiduspider-from-crawling-my-site\\\/\",\"name\":\"How do I block the Baiduspider from crawling my site? - UK-Cheapest.co.uk\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/#website\"},\"datePublished\":\"2010-11-25T10:38:31+00:00\",\"dateModified\":\"2011-12-09T14:44:29+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/how-do-i-block-the-baiduspider-from-crawling-my-site\\\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/how-do-i-block-the-baiduspider-from-crawling-my-site\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/how-do-i-block-the-baiduspider-from-crawling-my-site\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"UK-Cheapest.co.uk\",\"item\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How do I block the Baiduspider from crawling my site?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/#website\",\"url\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/\",\"name\":\"UK-Cheapest.co.uk\",\"description\":\"Cheap Domain Names, Web Hosting, Site Builder &amp; Web Security\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/#organization\",\"name\":\"UKC\",\"url\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/wp-content\\\/uploads\\\/2023\\\/12\\\/Screenshot-2023-12-14-at-17.40.07.png\",\"contentUrl\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/wp-content\\\/uploads\\\/2023\\\/12\\\/Screenshot-2023-12-14-at-17.40.07.png\",\"width\":217,\"height\":55,\"caption\":\"UKC\"},\"image\":{\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/x.com\\\/ukchelpdesk\",\"https:\\\/\\\/www.instagram.com\\\/ukc_hosting\\\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/#\\\/schema\\\/person\\\/135cf981b8a3a120603fcbc027eed746\",\"name\":\"UKC\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/afbfe91204852778e8698de79f854348bec9aea508bef650c084d0c6daf2588d?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/afbfe91204852778e8698de79f854348bec9aea508bef650c084d0c6daf2588d?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/afbfe91204852778e8698de79f854348bec9aea508bef650c084d0c6daf2588d?s=96&d=mm&r=g\",\"caption\":\"UKC\"},\"sameAs\":[\"https:\\\/\\\/www.uk-cheapest.co.uk\"],\"url\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/author\\\/colin\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"How do I block the Baiduspider from crawling my site? - UK-Cheapest.co.uk","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/","og_locale":"en_GB","og_type":"article","og_title":"How do I block the Baiduspider from crawling my site? - UK-Cheapest.co.uk","og_description":"How can I stop the Baidu Spider using up my site resources? Baidu is the most popular search engine in China. It can crawly your site twice as often as Google yet unless your site is in Mandarin, your site is unlikely to benefit from all that crawling. If you have a busy forum or ... Read more...","og_url":"https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/","og_site_name":"UK-Cheapest.co.uk","article_published_time":"2010-11-25T10:38:31+00:00","article_modified_time":"2011-12-09T14:44:29+00:00","og_image":[{"width":768,"height":439,"url":"https:\/\/www.uk-cheapest.co.uk\/support\/wp-content\/uploads\/2023\/12\/IMG_3064.jpeg","type":"image\/jpeg"}],"author":"UKC","twitter_card":"summary_large_image","twitter_creator":"@ukchelpdesk","twitter_site":"@ukchelpdesk","twitter_misc":{"Written by":"UKC","Estimated reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/#article","isPartOf":{"@id":"https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/"},"author":{"name":"UKC","@id":"https:\/\/www.uk-cheapest.co.uk\/support\/#\/schema\/person\/135cf981b8a3a120603fcbc027eed746"},"headline":"How do I block the Baiduspider from crawling my site?","datePublished":"2010-11-25T10:38:31+00:00","dateModified":"2011-12-09T14:44:29+00:00","mainEntityOfPage":{"@id":"https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/"},"wordCount":138,"commentCount":0,"publisher":{"@id":"https:\/\/www.uk-cheapest.co.uk\/support\/#organization"},"articleSection":["Support"],"inLanguage":"en-GB","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/","url":"https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/","name":"How do I block the Baiduspider from crawling my site? - UK-Cheapest.co.uk","isPartOf":{"@id":"https:\/\/www.uk-cheapest.co.uk\/support\/#website"},"datePublished":"2010-11-25T10:38:31+00:00","dateModified":"2011-12-09T14:44:29+00:00","breadcrumb":{"@id":"https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"UK-Cheapest.co.uk","item":"https:\/\/www.uk-cheapest.co.uk\/support\/"},{"@type":"ListItem","position":2,"name":"How do I block the Baiduspider from crawling my site?"}]},{"@type":"WebSite","@id":"https:\/\/www.uk-cheapest.co.uk\/support\/#website","url":"https:\/\/www.uk-cheapest.co.uk\/support\/","name":"UK-Cheapest.co.uk","description":"Cheap Domain Names, Web Hosting, Site Builder &amp; Web Security","publisher":{"@id":"https:\/\/www.uk-cheapest.co.uk\/support\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.uk-cheapest.co.uk\/support\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":"Organization","@id":"https:\/\/www.uk-cheapest.co.uk\/support\/#organization","name":"UKC","url":"https:\/\/www.uk-cheapest.co.uk\/support\/","logo":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/www.uk-cheapest.co.uk\/support\/#\/schema\/logo\/image\/","url":"https:\/\/www.uk-cheapest.co.uk\/support\/wp-content\/uploads\/2023\/12\/Screenshot-2023-12-14-at-17.40.07.png","contentUrl":"https:\/\/www.uk-cheapest.co.uk\/support\/wp-content\/uploads\/2023\/12\/Screenshot-2023-12-14-at-17.40.07.png","width":217,"height":55,"caption":"UKC"},"image":{"@id":"https:\/\/www.uk-cheapest.co.uk\/support\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/ukchelpdesk","https:\/\/www.instagram.com\/ukc_hosting\/"]},{"@type":"Person","@id":"https:\/\/www.uk-cheapest.co.uk\/support\/#\/schema\/person\/135cf981b8a3a120603fcbc027eed746","name":"UKC","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/secure.gravatar.com\/avatar\/afbfe91204852778e8698de79f854348bec9aea508bef650c084d0c6daf2588d?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/afbfe91204852778e8698de79f854348bec9aea508bef650c084d0c6daf2588d?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/afbfe91204852778e8698de79f854348bec9aea508bef650c084d0c6daf2588d?s=96&d=mm&r=g","caption":"UKC"},"sameAs":["https:\/\/www.uk-cheapest.co.uk"],"url":"https:\/\/www.uk-cheapest.co.uk\/support\/author\/colin\/"}]}},"_links":{"self":[{"href":"https:\/\/www.uk-cheapest.co.uk\/support\/wp-json\/wp\/v2\/posts\/943","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.uk-cheapest.co.uk\/support\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.uk-cheapest.co.uk\/support\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.uk-cheapest.co.uk\/support\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/www.uk-cheapest.co.uk\/support\/wp-json\/wp\/v2\/comments?post=943"}],"version-history":[{"count":4,"href":"https:\/\/www.uk-cheapest.co.uk\/support\/wp-json\/wp\/v2\/posts\/943\/revisions"}],"predecessor-version":[{"id":1135,"href":"https:\/\/www.uk-cheapest.co.uk\/support\/wp-json\/wp\/v2\/posts\/943\/revisions\/1135"}],"wp:attachment":[{"href":"https:\/\/www.uk-cheapest.co.uk\/support\/wp-json\/wp\/v2\/media?parent=943"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.uk-cheapest.co.uk\/support\/wp-json\/wp\/v2\/categories?post=943"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.uk-cheapest.co.uk\/support\/wp-json\/wp\/v2\/tags?post=943"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}