This tech CEO is trying to stop AI killing the internet. Why is everyone so mad at him?

In a significant shift, the internet is experiencing one of its most crucial transitions, moving away from traditional search engines towards AI-driven answer engines. This transformation is an economic upheaval that could disrupt the foundational business model of the web. While many tech firms embrace AI, Matthew Prince, the CEO of Cloudflare, warns that this change poses a critical threat to the internet. Prince emphasizes that the dynamics have fundamentally changed. “These aren’t search engines anymore; they’re answer engines. The economics and rules are very different,” he stated in a recent interview. For over two decades, Google’s search engine has effectively mapped the web, guiding users to information and generating traffic that supported the internet’s grand bargain—websites allowed Google to index their data in exchange for valuable referrals. However, in the current landscape dominated by AI tools like Google’s AI Overviews and OpenAI’s ChatGPT, the focus has shifted from generating traffic to delivering immediate answers. “Answer engines don’t drive traffic,” Prince pointed out, highlighting that without user visits, the existing economic model is at risk. Recent analysis by Barclays indicates a worrying trend: a sharp decline in website referrals in key sectors such as publishing and e-commerce. This decline coincides with an increase in AI bots harvesting data from websites without authorization, leading to inflated costs for maintaining web traffic. The statistics reveal a stark reality. Google now scans 18 pages for every user it directs to a site, compared to a two-to-one ratio a decade ago. “A year ago, it was five times more difficult to generate traffic from Google; now it’s ten times harder,” Prince noted, underscoring the growing challenges faced by content creators. Cloudflare, unlike many tech giants, is positioned to advocate for a solution. As a company that underpins a significant portion of the internet’s infrastructure, the well-being of the web directly affects its business. Earlier this year, Cloudflare took a decisive step by blocking AI bots by default and introducing a system that requires AI firms to compensate websites for accessing their content. These actions have sparked controversy. Guillermo Rauch, CEO of AI startup Vercel, criticized Cloudflare’s approach, calling it a hindrance to progress. Meanwhile, the startup Perplexity attempted to bypass Cloudflare’s restrictions, arguing that such measures limit user access to innovative services. Despite the backlash, Prince reports that many tech firms are open to the idea of paying for the data they utilize, as long as there is a level playing field. He believes that major players like Google recognize the need for change, stating, “I do think Google will pay for content. The only question is whether they do it voluntarily or are forced to.” Prince outlines three potential futures for the internet: a collapse of content, oligarchic control by a few tech giants, or a more collaborative model where AI companies compensate content creators. He envisions a system similar to Spotify’s, where creators are rewarded for producing high-quality content that enhances AI knowledge bases. This initiative, referred to internally at Cloudflare as "Act 4," symbolizes a new era aimed at redefining the relationship between technology and content creation. Prince is optimistic that this could lead to a healthier internet ecosystem, one that encourages thoughtful work rather than an obsession with traffic metrics. “What if we create a new business model that incentivizes creators to help fill gaps in knowledge? That’s a better world,” he concludes, hoping to spark a transformative conversation about the future of the internet.