Services

We build
high-quality websites
.

We are experts in creating websites that resonate with and convert

Let's work together!

Get a free consultation with our experts

Why us?

Behind every great website is a
great team
.

We have built 150+ websites for marketers and global brands.

Website

Latest
insights
.

A decade in the industry. 150+ websites built, optimized, and operated. Here we share what we’ve learned.

Case Study

Website migration from full-code to WordPress low-code solution

Read more
Read more
Services

Services

We build
high-quality websites
.

We are experts in creating websites that resonate with and convert

Let's work together!

Get a free consultation with our experts

About us

Why us?

Behind every great website is a
great team
.

We have built 150+ websites for marketers and global brands.

Insights

Cloudflare Blocks AI Crawlers by Default: What Changes on September 15?

Table of Contents

On September 15, Cloudflare implements default settings that block “mixed-use” AI crawlers and autonomous agents on ad-supported pages.

While traditional search indexing is still allowed, ❌ AI training bots are blocked.

This flips the old “default allow” rule to “default block” for new websites and free-tier users who have not manually changed their settings. If your site runs through Cloudflare, the new changes could quietly alter how visible your content is to major AI tools and search engines.

To verify or customize your crawler settings, log into your Cloudflare Dashboard and review your Security and Bot Management settings.

Picture of Tomáš Jendek

Tomáš Jendek

I'm Tomas, co-founder of Webgate — a WordPress & Elementor studio in Bratislava. We work with global B2B SaaS and tech companies, building websites as long-term marketing assets rather than one-off projects. I write about the unglamorous parts of running an agency: WordPress at scale, Elementor in production, client delivery, positioning, and the operational decisions. Opinions are sharpened by ten-plus years of shipping for clients with real deadlines.

Co-founder • Website & Growth Strategist

Share this artcle

Let's work together!

Get a free consultation with our experts

More
Articles
.

Blog

How a Single Extra Slash Caused Random Redirect Loops – and How We Traced It to the CDN

Read more
Read more
Blog

Why Paid Traffic Was Getting the Slowest Version of the Website

Read more
Read more
Blog

How Website Monitoring Helped Us Detect a Performance Drop Before It Became a Bigger Problem

Read more
Read more

Subscribe to our quarterly newsletter and receive latest insights.

Topics: Improving B2B websites, AI tools in web development, UX/UI, website marketing trends etc.

By submitting this form you agree to the processing of your personal data according to our .

Contact

Let's work together!

Get a free consulting call with our experts

Book a call with
Webgate founders

Thank you for your interest!

We will contact you soon.