Option to Allow AI Bots Access Despite Cloudflare Defaults
I’d like to suggest a feature improvement regarding AI bot access through Cloudflare.
I fully understand that Cloudflare now blocks AI scrapers by default. While I don’t necessarily need direct control over these settings, I’d highly appreciate any available way to allow AI bots to access and index our website – even if it’s something that could be handled via support on request.
Based on the current response from your support team, it seems this is not possible at all at the moment. However, enabling this functionality would be very valuable for us. We want our content to be accessible to AI systems (such as ChatGPT, Gemini, etc.) so they can discover and recommend our solutions to users.
Thanks for considering this as a potential enhancement in the future.
-
Evan Rees commented
This is a great suggestion. With Cloudflare now blocking most AI crawlers by default, it makes sense to offer a controlled way for site owners to explicitly *opt in* to AI bot access. Many of us actually want our content to be discoverable by reputable AI systems like ChatGPT, Gemini, and others — especially when they can drive visibility, recommendations, and traffic.
Right now, support has confirmed there’s no direct option or override available, which is limiting for businesses that depend on broader content reach.
An official mechanism — whether through a dashboard toggle, custom rule, or approved allowlist handled by support — would be extremely valuable. It would let site owners choose what’s best for their own content strategy while maintaining Cloudflare’s default protection for everyone else.
Thanks for considering this as a future enhancement. It would fill a meaningful gap for those of us who *want* AI accessibility rather than blocking it.
-
TYPICAL JOKER commented
I’ve been running into the same issue. My site, https://thestickwarlagacyapk.com
, publishes game updates, guides, and support info, and we actually want AI platforms to be able to read and reference our content. With Cloudflare blocking AI crawlers by default, it limits how easily players can discover accurate information through tools like ChatGPT. Having a safe, opt-in way to allow AI access would be incredibly useful for sites that don’t handle sensitive data. Really appreciate you highlighting this gap. -
Wendy Kelly commented
This is a really important point. Many content-driven sites like mine rely on being discoverable by AI systems so users can easily find accurate menu and product information. At https://7thbrewmenus.com/, we want our drink pages to be accessible to tools like ChatGPT and Gemini, but Cloudflare’s default blocking makes that difficult. Having an option to safely allow AI bots—especially for non-sensitive, informational sites—would be extremely helpful. Really glad you raised this feature request.
-
Michael Brown commented
It would be great to have an option to allow AI bots access despite Cloudflare’s default blocks. Even a controlled mechanism—like support-assisted whitelisting—would help AI systems discover and recommend our content, improving visibility without compromising security.
-
Lucas Tylor commented
Absolutely agree with this suggestion.
As a provider of https://pearllemonexperiences.com/creative-media-agency/ , discoverability is a critical part of our digital strategy. We want our content to be accessible to AI systems like ChatGPT and Gemini so that users actively seeking innovative marketing or media services can find and engage with what we offer.
While we understand the importance of protecting content from unauthorized scraping, having the *option* to allow trusted AI bots access – even through a support-based opt-in – would be a meaningful improvement. It strikes the right balance between control and visibility.
Appreciate you raising this – and hopeful Cloudflare considers adding more flexibility here.
-
James johnny commented
thanks for the suggestion. an option to allow ai bots, even if cloudflare blocks them by default, would be useful for site owners.
-
peterkhan commented
If you're using Cloudflare and want to allow AI bots access, make sure to whitelist their IP ranges or adjust your bot fight mode settings. By default, Cloudflare may block unfamiliar bots, even legitimate ones. Fine-tuning the firewall rules can help prevent unnecessary blocks while keeping security intact. https://infyieldscript.com/
-
Tumster Bruh commented
Do something about this, allow us to control whether we want AI bots or not... It has potentially huge impact on SEO, with the rise of AI overviews, and AI search.
-
David Ehrentreu commented
This is an important feature to enable for us please.