Increase of AI bots on the Internet sparks arms race

The emergence of the viral virtual assistant OpenClaw, previously known as Moltbot and Clawdbot, signifies a significant transformation that could reshape the Internet's landscape. A recent report from Akamai, an Internet infrastructure firm, highlights that AI bots now represent a substantial portion of online traffic, suggesting a potential future where autonomous bots could dominate the web. As these bots become more advanced, they are engaging in an escalating arms race, employing sophisticated strategies to circumvent security measures designed to block them. Toshit Pangrahi, CEO of TollBit, a company focused on monitoring web-scraping activities, states, "The majority of the Internet is going to be bot traffic in the future. It’s not just about copyright issues; we are witnessing the emergence of a new kind of visitor online." To combat this trend, many major websites are implementing restrictions on what content bots can access for training AI systems. This development is critical, especially as several publishers, including Condé Nast, are currently pursuing legal action against various AI companies over allegations of copyright violations related to AI training. In addition to training-related scraping, there is a noticeable increase in AI tools that fetch real-time information from the web, enhancing their outputs with the latest data, such as current product prices, movie showtimes, or recent news summaries. Akamai's data reveals a consistent rise in bot traffic associated with training since last July, coupled with a growing global trend of bots gathering web content for AI applications. Robert Blumofe, Akamai’s CTO, emphasizes the transformative impact of AI on the web, stating, "AI is changing the web as we know it. The ongoing arms race will shape the future design, usability, and functionality of the web, as well as the fundamental aspects of how business is conducted."