{"id":943,"date":"2010-11-25T11:38:31","date_gmt":"2010-11-25T10:38:31","guid":{"rendered":"https:\/\/www.uk-cheapest.co.uk\/support\/?p=943"},"modified":"2026-08-14T18:58:22","modified_gmt":"2026-08-14T17:58:22","slug":"how-do-i-block-the-baiduspider-from-crawling-my-site","status":"publish","type":"post","link":"https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/","title":{"rendered":"How to Block Baiduspider Safely"},"content":{"rendered":"\n<div class=\"ukc-organic-guide\">\n  <section class=\"ukc-organic-hero\" aria-labelledby=\"baiduspider-answer\">\n    <p class=\"ukc-organic-kicker\">Control unwanted crawler traffic safely<\/p>\n    <h2 id=\"baiduspider-answer\">Ask Baiduspider to stop in robots.txt first, then return 403 only if it keeps consuming resources<\/h2>\n    <p class=\"ukc-organic-lead\"><strong>Use the least disruptive control that solves the problem.<\/strong> A robots.txt rule is easy to reverse and preserves normal visitor access. A server or Cloudflare block is stronger but must be tested carefully because user-agent matching can be spoofed.<\/p>\n    <div class=\"ukc-organic-actions\">\n      <a class=\"ukc-organic-button\" href=\"#block-baiduspider-robots\">Add the robots.txt Rule<\/a>\n      <a class=\"ukc-organic-text-link\" href=\"#block-baiduspider-apache\">Use a 403 block<\/a>\n    <\/div>\n    <div class=\"ukc-organic-facts\" aria-label=\"Crawler blocking summary\">\n      <article><span>START<\/span><strong>robots.txt<\/strong><small>A crawl request, not access security<\/small><\/article>\n      <article><span>ESCALATE<\/span><strong>403 response<\/strong><small>Use when requests continue<\/small><\/article>\n      <article><span>VERIFY<\/span><strong>Logs and curl<\/strong><small>Confirm only the intended crawler is affected<\/small><\/article>\n    <\/div>\n  <\/section>\n\n  <nav class=\"ukc-organic-nav\" aria-label=\"On this page\">\n    <strong>On this page<\/strong>\n    <a href=\"#before-blocking-baiduspider\">Before blocking<\/a>\n    <a href=\"#block-baiduspider-robots\">robots.txt<\/a>\n    <a href=\"#block-baiduspider-apache\">Apache 403<\/a>\n    <a href=\"#block-baiduspider-cloudflare\">Cloudflare<\/a>\n    <a href=\"#test-baiduspider-block\">Test it<\/a>\n    <a href=\"#baiduspider-questions\">Questions<\/a>\n  <\/nav>\n\n  <h2 id=\"before-blocking-baiduspider\">Should you block Baiduspider?<\/h2>\n  <div class=\"ukc-organic-grid two\">\n    <article class=\"ukc-organic-card\"><h3>Block or limit it when<\/h3><p>Logs show sustained requests that consume bandwidth, PHP workers, database time or crawl capacity and the site does not need visibility in Baidu search.<\/p><\/article>\n    <article class=\"ukc-organic-card\"><h3>Leave it available when<\/h3><p>The business serves Chinese-speaking customers, depends on Baidu discovery or has no measurable resource problem from the crawler.<\/p><\/article>\n    <article class=\"ukc-organic-card\"><h3>Check the evidence first<\/h3><p>Confirm the user-agent, requested paths, response codes, request rate and time window in access logs. Do not act on an isolated visit.<\/p><\/article>\n    <article class=\"ukc-organic-card\"><h3>Fix expensive pages too<\/h3><p>A crawler may expose slow searches, broken links, endless calendar URLs or uncached dynamic pages that should be corrected regardless of the bot.<\/p><\/article>\n  <\/div>\n  <aside class=\"ukc-organic-warning\"><strong>Do not use robots.txt to protect private information.<\/strong> It is a public set of crawler instructions. Sensitive content needs authentication and proper access control.<\/aside>\n\n  <h2 id=\"block-baiduspider-robots\">How do you ask Baiduspider not to crawl the site?<\/h2>\n  <p>Add this group to the site&#8217;s root robots.txt file:<\/p>\n  <pre class=\"ukc-organic-code\"><code>User-agent: Baiduspider\nDisallow: \/<\/code><\/pre>\n  <ol class=\"ukc-organic-steps two\">\n    <li><span>1<\/span><div><strong>Open the correct website root<\/strong><p>In Plesk File Manager, open the document root for the domain, normally the directory containing the live site&#8217;s index file.<\/p><\/div><\/li>\n    <li><span>2<\/span><div><strong>Back up the existing robots.txt<\/strong><p>Download or copy it before editing. Existing search-engine, sitemap and plugin rules must be preserved.<\/p><\/div><\/li>\n    <li><span>3<\/span><div><strong>Add the Baiduspider group<\/strong><p>Place the two lines in a separate user-agent group. Do not add the disallow rule beneath a wildcard group unless every crawler should be blocked.<\/p><\/div><\/li>\n    <li><span>4<\/span><div><strong>Open the public file<\/strong><p>Visit https:\/\/yourdomain.example\/robots.txt and confirm it returns plain text with the new rule.<\/p><\/div><\/li>\n  <\/ol>\n  <p>WordPress can generate a virtual robots.txt when no physical file exists. If an SEO or security plugin manages it, use that plugin&#8217;s supported editor or create a carefully reviewed root file. Avoid having several tools compete to generate different versions.<\/p>\n\n  <h2>What does the robots.txt rule do?<\/h2>\n  <div class=\"ukc-organic-grid two\">\n    <article class=\"ukc-organic-card\"><h3>It requests no crawling<\/h3><p>A compliant crawler that identifies as Baiduspider should stop requesting paths covered by the slash rule after it refreshes the file.<\/p><\/article>\n    <article class=\"ukc-organic-card\"><h3>It does not return an error<\/h3><p>The website remains available if that user-agent requests it. robots.txt is instruction, not enforcement.<\/p><\/article>\n    <article class=\"ukc-organic-card\"><h3>It can take time<\/h3><p>The crawler may cache robots.txt and already queued URLs may still appear in logs for a while.<\/p><\/article>\n    <article class=\"ukc-organic-card\"><h3>It does not guarantee removal<\/h3><p>Blocking crawling is different from removing known URLs from a search index. Search engines may retain a URL reference without revisiting the content.<\/p><\/article>\n  <\/div>\n\n  <h2 id=\"block-baiduspider-apache\">How do you return 403 to Baiduspider on Apache?<\/h2>\n  <p>If requests continue and resource use justifies enforcement, back up the live .htaccess file and place this block before the normal application rewrite rules:<\/p>\n  <pre class=\"ukc-organic-code\"><code>&lt;IfModule mod_rewrite.c&gt;\nRewriteEngine On\nRewriteCond %{HTTP_USER_AGENT} Baiduspider [NC]\nRewriteRule ^ - [F,L]\n&lt;\/IfModule&gt;<\/code><\/pre>\n  <p>The <code>F<\/code> flag returns HTTP 403 Forbidden and <code>L<\/code> stops later rewrite processing for that request. The old 2010 advice used <code>BrowserMatchNoCase<\/code> with <code>Deny from env<\/code>, an Apache 2.2-era access-control pattern that should not be copied into a current Apache 2.4 configuration.<\/p>\n  <aside class=\"ukc-organic-warning\"><strong>A user-agent block is not strong identity verification.<\/strong> Any client can claim to be Baiduspider, and an unwanted bot can change its header. Use this for resource control, not as a security boundary.<\/aside>\n\n  <h2 id=\"block-baiduspider-cloudflare\">Can Cloudflare block the crawler before it reaches hosting?<\/h2>\n  <p>Yes. When the domain is proxied through Cloudflare, a custom security rule can match requests whose user-agent contains <code>Baiduspider<\/code> and block or challenge them at the edge. This can reduce origin traffic more effectively than .htaccess.<\/p>\n  <div class=\"ukc-organic-grid two\">\n    <article class=\"ukc-organic-card\"><h3>Use a narrow expression<\/h3><p>Match the intended user-agent text case-insensitively and apply it only to the relevant hostname or site.<\/p><\/article>\n    <article class=\"ukc-organic-card\"><h3>Review before enabling<\/h3><p>Use rule preview, security events or log data where available. Check that normal browsers and monitoring services do not match.<\/p><\/article>\n    <article class=\"ukc-organic-card\"><h3>Choose block or managed challenge<\/h3><p>A block is predictable for an unwanted crawler. A challenge is less absolute but can still consume requests and may not suit an automated bot.<\/p><\/article>\n    <article class=\"ukc-organic-card\"><h3>Keep the rule documented<\/h3><p>Record why it exists, when it was added and how to disable it if the business later wants Baidu search visibility.<\/p><\/article>\n  <\/div>\n\n  <h2 id=\"test-baiduspider-block\">How do you test the result?<\/h2>\n  <div class=\"ukc-organic-table-wrap\" role=\"region\" aria-label=\"Baiduspider block tests\" tabindex=\"0\">\n    <table class=\"ukc-organic-table\">\n      <thead><tr><th scope=\"col\">Test<\/th><th scope=\"col\">Command or action<\/th><th scope=\"col\">Expected result<\/th><\/tr><\/thead>\n      <tbody>\n        <tr><th scope=\"row\">robots.txt<\/th><td>Open \/robots.txt in a normal browser<\/td><td>HTTP 200 and the Baiduspider group appears once<\/td><\/tr>\n        <tr><th scope=\"row\">Normal visitor<\/th><td>Open several public pages normally<\/td><td>The same successful pages and assets as before<\/td><\/tr>\n        <tr><th scope=\"row\">Spoofed crawler header<\/th><td><code>curl -A \"Baiduspider\" -I https:\/\/example.com\/<\/code><\/td><td>HTTP 403 only when the hard block is enabled<\/td><\/tr>\n        <tr><th scope=\"row\">Logs<\/th><td>Compare request counts and status codes after the change<\/td><td>Requests fall after robots.txt or receive 403 at the chosen layer<\/td><\/tr>\n        <tr><th scope=\"row\">Other search engines<\/th><td>Review Google and Bing crawling or test their user-agents<\/td><td>They remain unaffected by the specific rule<\/td><\/tr>\n      <\/tbody>\n    <\/table>\n  <\/div>\n\n  <h2>Which approaches should you avoid?<\/h2>\n  <div class=\"ukc-organic-grid two\">\n    <article class=\"ukc-organic-card\"><h3>Copying old Apache 2.2 directives<\/h3><p><code>Deny from<\/code> may rely on compatibility modules and can behave differently in modern hosting. Use a current, tested method.<\/p><\/article>\n    <article class=\"ukc-organic-card\"><h3>Maintaining random IP lists<\/h3><p>Crawler networks change. Third-party lists become stale and can block unrelated visitors or miss new addresses.<\/p><\/article>\n    <article class=\"ukc-organic-card\"><h3>Blocking every bot<\/h3><p>A wildcard ban can remove useful search, monitoring and service traffic. Match only the crawler or paths causing the problem.<\/p><\/article>\n    <article class=\"ukc-organic-card\"><h3>Editing without rollback<\/h3><p>A syntax error in .htaccess can make the whole site return HTTP 500. Keep a copy and know how to restore it through Plesk.<\/p><\/article>\n  <\/div>\n\n  <h2 id=\"baiduspider-questions\">Baiduspider blocking questions<\/h2>\n  <div class=\"ukc-organic-faq\">\n    <details open><summary>Will robots.txt stop Baiduspider immediately?<\/summary><p>Not necessarily. The crawler may use a cached copy and have requests already queued. Monitor logs over time before deciding the request was ignored.<\/p><\/details>\n    <details><summary>Will blocking Baiduspider affect Google?<\/summary><p>Not when the rule specifically targets Baiduspider and is implemented correctly. Test normal pages and review the complete robots.txt so a wildcard rule has not been changed accidentally.<\/p><\/details>\n    <details><summary>Can I block only an expensive path?<\/summary><p>Yes. In robots.txt replace the slash with the path prefix, or narrow the server or edge rule. This can preserve general discovery while protecting searches, calendars or other costly sections.<\/p><\/details>\n    <details><summary>Why do requests continue after a 403 rule?<\/summary><p>A server block stops application access but does not force the remote client to stop sending requests. An edge block can protect the origin, while rate limiting or provider assistance may be needed for persistent abusive traffic.<\/p><\/details>\n    <details><summary>Can I block Baiduspider by IP?<\/summary><p>It is possible, but static lists age quickly and require careful verification. Prefer crawler instructions or an edge security rule unless you have current, authoritative network data.<\/p><\/details>\n    <details><summary>Should I ask support before editing .htaccess?<\/summary><p>Yes if you are not comfortable restoring the file after a syntax problem. Include the domain, sample log lines and the observed resource effect, but remove passwords and unrelated personal data.<\/p><\/details>\n  <\/div>\n\n  <aside class=\"ukc-organic-source\"><strong>Technical guidance checked 14 August 2026:<\/strong> Google&#8217;s <a href=\"https:\/\/developers.google.com\/search\/blog\/2025\/03\/robotstxt-flexible-way-to-control\">robots.txt refresher<\/a> explains crawler-specific groups and disallow rules. Apache&#8217;s <a href=\"https:\/\/httpd.apache.org\/docs\/2.4\/howto\/access.html\">2.4 access-control guide<\/a> documents 403 blocking and warns that user-agent access control is unreliable as an identity check.<\/aside>\n\n  <section class=\"ukc-organic-final\" aria-labelledby=\"baiduspider-final\">\n    <div><p class=\"ukc-organic-kicker\">Need help checking the logs?<\/p><h2 id=\"baiduspider-final\">Start with evidence and keep a rollback copy<\/h2><p>Send support the affected domain, time window, example requests and resource symptom. Do not send account passwords.<\/p><\/div>\n    <div class=\"ukc-organic-final-actions\">\n      <a class=\"ukc-organic-button\" href=\"https:\/\/billing.uk-cheapest.co.uk\/submitticket.php\" data-ukc-organic-cta=\"support\" data-ukc-organic-destination=\"helpdesk\">Ask UKC Support<\/a>\n      <a href=\"https:\/\/billing.uk-cheapest.co.uk\/clientarea.php?action=services\" data-ukc-organic-cta=\"services\" data-ukc-organic-destination=\"account\">Open My Services<\/a>\n    <\/div>\n  <\/section>\n<\/div>\n\n","protected":false},"excerpt":{"rendered":"<p>Control unwanted crawler traffic safely Ask Baiduspider to stop in robots.txt first, then return 403 only if it keeps consuming resources Use the least disruptive control that solves the problem. A robots.txt rule is easy to reverse and preserves normal visitor access. A server or Cloudflare block is stronger but must be tested carefully because &#8230; <a title=\"How to Block Baiduspider Safely\" class=\"read-more\" href=\"https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/\" aria-label=\"Read more about How to Block Baiduspider Safely\">Read more&#8230;<\/a><\/p>\n","protected":false},"author":4,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"generate_page_header":"","footnotes":""},"categories":[61],"tags":[],"class_list":["post-943","post","type-post","status-publish","format-standard","hentry","category-support"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.6 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>How to Block Baiduspider with robots.txt or Apache | UKC<\/title>\n<meta name=\"description\" content=\"Block Baiduspider safely with robots.txt first, then a tested Apache 2.4 or Cloudflare rule if crawler traffic still consumes website resources.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How to Block Baiduspider with robots.txt or Apache | UKC\" \/>\n<meta property=\"og:description\" content=\"Block Baiduspider safely with robots.txt first, then a tested Apache 2.4 or Cloudflare rule if crawler traffic still consumes website resources.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/\" \/>\n<meta property=\"og:site_name\" content=\"UK-Cheapest.co.uk\" \/>\n<meta property=\"article:published_time\" content=\"2010-11-25T10:38:31+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-08-14T17:58:22+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.uk-cheapest.co.uk\/support\/wp-content\/uploads\/2026\/08\/ogimage1.jpeg\" \/>\n\t<meta property=\"og:image:width\" content=\"1731\" \/>\n\t<meta property=\"og:image:height\" content=\"908\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"UKC\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@ukchelpdesk\" \/>\n<meta name=\"twitter:site\" content=\"@ukchelpdesk\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"UKC\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/how-do-i-block-the-baiduspider-from-crawling-my-site\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/how-do-i-block-the-baiduspider-from-crawling-my-site\\\/\"},\"author\":{\"name\":\"UKC\",\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/#\\\/schema\\\/person\\\/135cf981b8a3a120603fcbc027eed746\"},\"headline\":\"How to Block Baiduspider Safely\",\"datePublished\":\"2010-11-25T10:38:31+00:00\",\"dateModified\":\"2026-08-14T17:58:22+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/how-do-i-block-the-baiduspider-from-crawling-my-site\\\/\"},\"wordCount\":1220,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/#organization\"},\"articleSection\":[\"Support\"],\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/how-do-i-block-the-baiduspider-from-crawling-my-site\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/how-do-i-block-the-baiduspider-from-crawling-my-site\\\/\",\"url\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/how-do-i-block-the-baiduspider-from-crawling-my-site\\\/\",\"name\":\"How to Block Baiduspider with robots.txt or Apache | UKC\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/#website\"},\"datePublished\":\"2010-11-25T10:38:31+00:00\",\"dateModified\":\"2026-08-14T17:58:22+00:00\",\"description\":\"Block Baiduspider safely with robots.txt first, then a tested Apache 2.4 or Cloudflare rule if crawler traffic still consumes website resources.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/how-do-i-block-the-baiduspider-from-crawling-my-site\\\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/how-do-i-block-the-baiduspider-from-crawling-my-site\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/how-do-i-block-the-baiduspider-from-crawling-my-site\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"UK-Cheapest.co.uk\",\"item\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How to Block Baiduspider Safely\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/#website\",\"url\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/\",\"name\":\"UK-Cheapest.co.uk\",\"description\":\"Cheap Domain Names, Web Hosting, Site Builder &amp; Web Security\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/#organization\",\"name\":\"UKC\",\"url\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/wp-content\\\/uploads\\\/2023\\\/12\\\/Screenshot-2023-12-14-at-17.40.07.png\",\"contentUrl\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/wp-content\\\/uploads\\\/2023\\\/12\\\/Screenshot-2023-12-14-at-17.40.07.png\",\"width\":217,\"height\":55,\"caption\":\"UKC\"},\"image\":{\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/x.com\\\/ukchelpdesk\",\"https:\\\/\\\/www.instagram.com\\\/ukc_hosting\\\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/#\\\/schema\\\/person\\\/135cf981b8a3a120603fcbc027eed746\",\"name\":\"UKC\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/afbfe91204852778e8698de79f854348bec9aea508bef650c084d0c6daf2588d?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/afbfe91204852778e8698de79f854348bec9aea508bef650c084d0c6daf2588d?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/afbfe91204852778e8698de79f854348bec9aea508bef650c084d0c6daf2588d?s=96&d=mm&r=g\",\"caption\":\"UKC\"},\"sameAs\":[\"https:\\\/\\\/www.uk-cheapest.co.uk\"],\"url\":\"https:\\\/\\\/www.uk-cheapest.co.uk\\\/support\\\/author\\\/colin\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"How to Block Baiduspider with robots.txt or Apache | UKC","description":"Block Baiduspider safely with robots.txt first, then a tested Apache 2.4 or Cloudflare rule if crawler traffic still consumes website resources.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/","og_locale":"en_GB","og_type":"article","og_title":"How to Block Baiduspider with robots.txt or Apache | UKC","og_description":"Block Baiduspider safely with robots.txt first, then a tested Apache 2.4 or Cloudflare rule if crawler traffic still consumes website resources.","og_url":"https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/","og_site_name":"UK-Cheapest.co.uk","article_published_time":"2010-11-25T10:38:31+00:00","article_modified_time":"2026-08-14T17:58:22+00:00","og_image":[{"width":1731,"height":908,"url":"https:\/\/www.uk-cheapest.co.uk\/support\/wp-content\/uploads\/2026\/08\/ogimage1.jpeg","type":"image\/jpeg"}],"author":"UKC","twitter_card":"summary_large_image","twitter_creator":"@ukchelpdesk","twitter_site":"@ukchelpdesk","twitter_misc":{"Written by":"UKC","Estimated reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/#article","isPartOf":{"@id":"https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/"},"author":{"name":"UKC","@id":"https:\/\/www.uk-cheapest.co.uk\/support\/#\/schema\/person\/135cf981b8a3a120603fcbc027eed746"},"headline":"How to Block Baiduspider Safely","datePublished":"2010-11-25T10:38:31+00:00","dateModified":"2026-08-14T17:58:22+00:00","mainEntityOfPage":{"@id":"https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/"},"wordCount":1220,"commentCount":0,"publisher":{"@id":"https:\/\/www.uk-cheapest.co.uk\/support\/#organization"},"articleSection":["Support"],"inLanguage":"en-GB","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/","url":"https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/","name":"How to Block Baiduspider with robots.txt or Apache | UKC","isPartOf":{"@id":"https:\/\/www.uk-cheapest.co.uk\/support\/#website"},"datePublished":"2010-11-25T10:38:31+00:00","dateModified":"2026-08-14T17:58:22+00:00","description":"Block Baiduspider safely with robots.txt first, then a tested Apache 2.4 or Cloudflare rule if crawler traffic still consumes website resources.","breadcrumb":{"@id":"https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.uk-cheapest.co.uk\/support\/how-do-i-block-the-baiduspider-from-crawling-my-site\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"UK-Cheapest.co.uk","item":"https:\/\/www.uk-cheapest.co.uk\/support\/"},{"@type":"ListItem","position":2,"name":"How to Block Baiduspider Safely"}]},{"@type":"WebSite","@id":"https:\/\/www.uk-cheapest.co.uk\/support\/#website","url":"https:\/\/www.uk-cheapest.co.uk\/support\/","name":"UK-Cheapest.co.uk","description":"Cheap Domain Names, Web Hosting, Site Builder &amp; Web Security","publisher":{"@id":"https:\/\/www.uk-cheapest.co.uk\/support\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.uk-cheapest.co.uk\/support\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":"Organization","@id":"https:\/\/www.uk-cheapest.co.uk\/support\/#organization","name":"UKC","url":"https:\/\/www.uk-cheapest.co.uk\/support\/","logo":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/www.uk-cheapest.co.uk\/support\/#\/schema\/logo\/image\/","url":"https:\/\/www.uk-cheapest.co.uk\/support\/wp-content\/uploads\/2023\/12\/Screenshot-2023-12-14-at-17.40.07.png","contentUrl":"https:\/\/www.uk-cheapest.co.uk\/support\/wp-content\/uploads\/2023\/12\/Screenshot-2023-12-14-at-17.40.07.png","width":217,"height":55,"caption":"UKC"},"image":{"@id":"https:\/\/www.uk-cheapest.co.uk\/support\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/ukchelpdesk","https:\/\/www.instagram.com\/ukc_hosting\/"]},{"@type":"Person","@id":"https:\/\/www.uk-cheapest.co.uk\/support\/#\/schema\/person\/135cf981b8a3a120603fcbc027eed746","name":"UKC","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/secure.gravatar.com\/avatar\/afbfe91204852778e8698de79f854348bec9aea508bef650c084d0c6daf2588d?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/afbfe91204852778e8698de79f854348bec9aea508bef650c084d0c6daf2588d?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/afbfe91204852778e8698de79f854348bec9aea508bef650c084d0c6daf2588d?s=96&d=mm&r=g","caption":"UKC"},"sameAs":["https:\/\/www.uk-cheapest.co.uk"],"url":"https:\/\/www.uk-cheapest.co.uk\/support\/author\/colin\/"}]}},"_links":{"self":[{"href":"https:\/\/www.uk-cheapest.co.uk\/support\/wp-json\/wp\/v2\/posts\/943","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.uk-cheapest.co.uk\/support\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.uk-cheapest.co.uk\/support\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.uk-cheapest.co.uk\/support\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/www.uk-cheapest.co.uk\/support\/wp-json\/wp\/v2\/comments?post=943"}],"version-history":[{"count":5,"href":"https:\/\/www.uk-cheapest.co.uk\/support\/wp-json\/wp\/v2\/posts\/943\/revisions"}],"predecessor-version":[{"id":5561,"href":"https:\/\/www.uk-cheapest.co.uk\/support\/wp-json\/wp\/v2\/posts\/943\/revisions\/5561"}],"wp:attachment":[{"href":"https:\/\/www.uk-cheapest.co.uk\/support\/wp-json\/wp\/v2\/media?parent=943"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.uk-cheapest.co.uk\/support\/wp-json\/wp\/v2\/categories?post=943"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.uk-cheapest.co.uk\/support\/wp-json\/wp\/v2\/tags?post=943"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}