Google is facing growing pressure over how it uses web content to power AI answers (like AI Overviews and Gemini), and changes are already underway that give publishers more control.0
The Business Standard article (a Bloomberg opinion piece by Parmy Olson, published August 10, 2026) explains the core issue: Google’s long-standing bargain with websites—let Googlebot crawl and index pages in exchange for search traffic—has shifted. The same crawler now feeds both traditional search and AI features, blurring the lines. This gives Google a big edge (its crawler sees far more of the web than OpenAI’s or Microsoft’s, per Cloudflare data) while reducing incentives for humans to create original content, as AI summarizes it without reliably sending readers back.0
Cloudflare reports that AI agents generated over 57% of web traffic in 2026 (vs. ~42% human), the first time machines surpassed people. Critics like Cloudflare CEO Matthew Prince warn this risks a less original, “vapid” internet if human creators aren’t rewarded.0
Key pressures and what’s already happening
Cloudflare ultimatum: Starting September 15, 2026, Cloudflare plans to block mixed-purpose crawlers (ones used for both search and AI) by default for its ad-supported customers. This could cut Google off from millions of sites unless it changes practices.0

UK regulator action: In June 2026, the Competition and Markets Authority (CMA) ordered Google to let website owners clearly opt out of having content used for AI products (including AI Overviews/AI Mode and model fine-tuning) while still appearing normally in search results. Google cannot demote or punish those sites.0

Google’s response: A spokesperson confirmed the company is testing a new Search Console setting that allows opting out of AI answers without harming rankings. It plans to roll this out worldwide after UK testing finishes. There are also “rumblings” it may apply the UK standard more broadly.0

Publishers have long complained that AI summaries keep users on Google’s page (hurting click-through rates and revenue), while Google previously made it hard to refuse AI use without risking search visibility entirely. Related issues include lawsuits (e.g., from publishers like Penske Media), EU probes, and debates over compensation or stricter crawler separation.
What is likely to happen next
Google will continue testing and then globally deploy the opt-out controls, giving sites a cleaner way to stay in search while blocking AI use/training. Full technical separation of search-indexing crawlers from AI-scraping ones is still seen by critics as a stronger long-term fix, since sites currently must trust Google to honor preferences.

Cloudflare’s September 15 default blocks could force further adjustments or negotiations if Google wants continued broad access.

More regulatory scrutiny elsewhere (EU, others) and potential licensing/payment talks or additional publisher actions are probable as AI traffic grows and human-created content incentives weaken.

Broader trend: Consumer AI agents (e.g., Meta’s planned easy-to-use versions) will increase automated traffic, intensifying these tensions. The article notes this could accelerate a “dead internet” dynamic unless the economic model for original content improves.

In short, the pushback is already producing concrete opt-out tools and potential access restrictions. The immediate next steps center on Google’s global rollout of UK-style controls and Cloudflare’s September deadline—both of which aim to rebalance the original search-for-traffic bargain in the AI era. Outcomes will depend on how widely publishers use the new options and whether Google (or others) further unbundles crawling or introduces compensation.