Option to Allow AI Bots Access Despite Cloudflare Defaults
I’d like to suggest a feature improvement regarding AI bot access through Cloudflare.
I fully understand that Cloudflare now blocks AI scrapers by default. While I don’t necessarily need direct control over these settings, I’d highly appreciate any available way to allow AI bots to access and index our website – even if it’s something that could be handled via support on request.
Based on the current response from your support team, it seems this is not possible at all at the moment. However, enabling this functionality would be very valuable for us. We want our content to be accessible to AI systems (such as ChatGPT, Gemini, etc.) so they can discover and recommend our solutions to users.
Thanks for considering this as a potential enhancement in the future.
-
Michael Brown commented
It would be great to have an option to allow AI bots access despite Cloudflare’s default blocks. Even a controlled mechanism—like support-assisted whitelisting—would help AI systems discover and recommend our content, improving visibility without compromising security.
-
Lucas Tylor commented
Absolutely agree with this suggestion.
As a provider of https://pearllemonexperiences.com/creative-media-agency/ , discoverability is a critical part of our digital strategy. We want our content to be accessible to AI systems like ChatGPT and Gemini so that users actively seeking innovative marketing or media services can find and engage with what we offer.
While we understand the importance of protecting content from unauthorized scraping, having the *option* to allow trusted AI bots access – even through a support-based opt-in – would be a meaningful improvement. It strikes the right balance between control and visibility.
Appreciate you raising this – and hopeful Cloudflare considers adding more flexibility here.
-
James johnny commented
thanks for the suggestion. an option to allow ai bots, even if cloudflare blocks them by default, would be useful for site owners.
-
peterkhan commented
If you're using Cloudflare and want to allow AI bots access, make sure to whitelist their IP ranges or adjust your bot fight mode settings. By default, Cloudflare may block unfamiliar bots, even legitimate ones. Fine-tuning the firewall rules can help prevent unnecessary blocks while keeping security intact. https://infyieldscript.com/
-
Tumster Bruh commented
Do something about this, allow us to control whether we want AI bots or not... It has potentially huge impact on SEO, with the rise of AI overviews, and AI search.
-
David Ehrentreu commented
This is an important feature to enable for us please.