AI scraping for search refers to the practice of using automated systems to collect, process, and summarize content from websites in order to generate AI-powered search results, such as Google’s AI Overviews. These summaries appear directly at the top of search results pages, giving users quick answers without requiring them to click through to the original source. While convenient for searchers, this practice has become deeply controversial among publishers who argue it siphons away the traffic their businesses depend on, all while using the very content those publishers created.
In this article, we’ll discuss the UK’s Competition and Markets Authority (CMA) and its landmark decision to order Google to give publishers opt-out controls for AI-generated search features. We’ll explore why this ruling matters, how it could reshape the relationship between Big Tech and the publishing industry, and what it signals for content creators and digital marketers around the world.
TL;DR Snapshot
The UK’s CMA has issued what it calls a “world first” ruling, ordering Google to provide publishers with tools that let them opt out of having their content used in AI Overviews, AI Mode, and AI model training, without losing their place in traditional search results.
Key takeaways include…
- Publishers will be able to separately control whether their content is used for AI-generated search features and AI model training, without having to opt out of Google Search entirely.
- Google is prohibited from penalizing publishers in search rankings if they choose to opt out, and must properly attribute content with clear links in AI-generated results.
- The ruling could set a global precedent, with Google already indicating it will test the new controls in the UK first before rolling them out worldwide.
Who should read this: Digital marketers, content creators, SEO professionals, publishers, and anyone interested in the evolving intersection of AI and content rights.
Why the CMA Stepped In: The Publisher Traffic Crisis
To understand why the UK took this step, you need to look at the scale of the damage AI Overviews have caused publishers. When Google rolled out AI Overviews in mid-2024, it fundamentally changed how users interact with search results. Instead of scanning a list of links and clicking through to websites, users increasingly get their answers directly from AI-generated summaries at the top of the page.
The numbers paint a stark picture. A recent PixelMojo article noted that Google search referrals to publishers dropped by roughly a third globally in 2025 (and around 38% in the United States). A report from Neowin showed that small publishers saw their Google referral traffic decline by 60% over the past two years, while medium-sized publishers experienced a 47% drop. And even large publishers weren’t spared, losing around 22% of their traditional search referrals. According to The Next Web, AI Overviews were correlated with a 58% reduction in click-through rates for top-ranking pages.
The core problem, as VideoWeek reported, was that publishers had no real choice when it came to inclusion. They could either allow Google to scrape their content for AI features, or opt out of Google Search entirely, which would starve them of traffic altogether. Multiple publishers told the CMA in their submissions that they were essentially forced to consent to AI scraping because opting out of Google’s search engine wasn’t a realistic option.
What the Ruling Actually Requires
The CMA’s decision goes beyond a simple opt-out checkbox. It introduces a set of specific, enforceable requirements designed to give publishers genuine control over how their content is used.
First, publishers will be able to separately control whether their content is used for AI “grounding” (powering AI-generated answers in search) and for AI model training and fine-tuning. As VideoWeek noted, the fine-tuning control is particularly important because publishers had argued that Google could use fine-tuning as a workaround to access content from publishers who opted out of grounding. These controls will work at both the domain level and the individual page level.
Second, Google is explicitly barred from retaliating. If a publisher opts out of AI features, Google cannot penalize them in traditional search rankings. This is a critical protection because without it, the opt-out would carry an implicit threat of reduced visibility.
Third, Google must properly cite and attribute publisher content in AI-generated search results by using clear links. CMA Chief Executive Sarah Cardell stated that the measures will deliver fair treatment, greater transparency, and meaningful choice for both businesses and consumers, according to the ABC News report.
Google has nine months to implement the changes and will need to submit regular compliance reports to the CMA.
The Bigger Picture: A Global Precedent in the Making
The CMA has called its ruling a “world first,” and there’s reason to believe it could ripple far beyond the UK’s borders. Google has already indicated that after testing the opt-out controls in the UK, it plans to roll them out globally, according to Technology.org’s reporting.
This decision didn’t happen in a vacuum, it’s part of the UK’s broader digital markets competition regime, which grants regulators the power to impose specific conduct requirements on companies with “strategic market status.” The CMA designated Google as such a player in online search advertising, and this ruling is one of the first concrete exercises of those new powers.
Publishers around the world have been pushing back against AI scraping through various channels. As The Next Web notes, Penske Media Corporation filed an antitrust lawsuit against Google in September 2025, alleging that Google abuses its search monopoly by forcing publishers to allow their content to be used in AI Overviews. The EU has also opened investigations into whether Google is cannibalizing the web content its business relies on.
However, not everyone is convinced the CMA’s timeline is aggressive enough. Tim Cowen, co-founder of the advocacy group Movement for an Open Web, told VideoWeek that a harm that started over three years ago and has gone without a remedy will continue to be unaddressed for another nine months, and that effective compliance won’t be verifiable until late 2027.
The real strategic impact of the ruling may not be mass opt-outs, though. As VideoWeek pointed out, having the ability to opt out gives publishers a stronger bargaining position when negotiating content licensing deals with Google. Instead of being forced to accept AI scraping as a precondition of appearing in search, publishers can now come to the table with genuine leverage.
What This Means for Content Creators and Digital Marketers
If you’re a content creator, marketer, or SEO professional, this ruling matters whether you’re based in the UK or not. The opt-out controls Google is testing in the UK are expected to roll out worldwide, which means the tools and decisions involved will eventually apply to your content as well.
For publishers and creators, the immediate question becomes whether to opt out of AI features, stay in, or use the new leverage to negotiate better terms with Google. Each path carries trade-offs. Opting out may protect click-through traffic, but it also means your content won’t appear in AI-generated summaries that are becoming an increasingly prominent part of how users discover information. Staying in means accepting that some portion of your potential traffic will be absorbed by AI Overviews.
For digital marketers and SEO professionals, the shifting landscape means rethinking strategies that have long depended on Google search traffic as a primary acquisition channel. With overall page views from Google search referrals falling 34% in a single year according to Neowin, diversifying traffic sources and maximizing revenue per session are becoming essential strategies.
Regardless of where the industry lands, the CMA’s decision represents a meaningful shift in the power dynamic between Big Tech and the publishers whose content fuels AI-powered products. It won’t solve every problem overnight, but it establishes a new baseline. Publishers should have the right to choose how their content is used, and dominant platforms can’t force compliance through lack of alternatives.
Frequently Asked Questions
The Competition and Markets Authority (CMA) is the UK’s independent competition regulator. It’s responsible for promoting competition, investigating mergers, and enforcing consumer protection laws. Under the UK’s newer digital markets competition regime, the CMA has been granted enhanced powers to regulate companies that hold “strategic market status” in digital markets, which is the authority it used to issue this ruling against Google.
AI Overviews are AI-generated summaries that appear at the top of certain Google search results. Launched in mid-2024, they use content scraped from websites across the web to provide users with concise answers to their queries directly on the search results page. While they offer convenience for users, they’ve been widely criticized by publishers because they reduce click-through traffic to the original sources.
AI Mode is a more recent Google search feature that further integrates generative AI into the search experience. It allows users to have more conversational, in-depth interactions with Google’s AI directly within search, going beyond the brief summaries provided by AI Overviews. Like AI Overviews, it draws on publisher content to generate its responses.
Fine-tuning is a process where an existing AI model is further trained on specific datasets to improve its performance on particular tasks or topics. Publishers raised concerns with the CMA that Google could use fine-tuning to effectively absorb their content into AI models even if those publishers had opted out of grounding, which is why the ruling includes separate controls for both grounding and fine-tuning.
In the context of AI search features, grounding refers to the process of connecting an AI model’s outputs to real, verifiable information from external sources, such as publisher websites. When Google’s AI Overviews are “grounded” in a publisher’s content, it means the AI is using that content to inform and support the answers it generates. The CMA’s ruling gives publishers the ability to opt out of having their content used for this purpose.
The Movement for an Open Web is an industry advocacy group that campaigns for fair competition and open standards on the internet. In the context of this ruling, MOW has been vocal about the CMA’s timeline, arguing that a nine-month implementation window is too slow given how long publishers have already been losing traffic to AI-powered search features.
Other Enterprise AI Articles You May Be Interested In
Claude Opus 4.8: Everything You Need to Know About Anthropic’s New AI Model
Mailchimp Launches Analytics AI: What Ecommerce Brands Need to Know
CNN Sues Perplexity AI Over Copyright Theft: What You Need to Know
Disarm AI: Inside Pope Leo’s Encyclical and Its Challenge to the Trump Administration’s AI Strategy
OpenAI Just Solved a Problem That Stumped Mathematicians for 80 Years
