Big Tech firms spending trillions on superintelligence systems are playing 'Russian roulette' with humanity, an AI pioneer says

A prominent figure in artificial intelligence has issued a stark warning, suggesting that major tech companies are recklessly gambling with the future of humanity by investing trillions into superintelligent AI systems. Stuart Russell, a leading researcher and professor at the University of California, Berkeley, emphasized that these corporations are venturing into unknown territory with technologies they do not fully comprehend. Russell expressed grave concerns about the implications of creating entities that surpass human intelligence without a clear strategy for controlling them. He stated in an interview with CNBC, "If you create entities that are more powerful than human beings and you have no idea how to maintain power over them, then you're just asking for trouble." He highlighted the complexity of modern AI models, which are built on trillions of parameters refined through extensive random adjustments. Even the experts developing these systems struggle to grasp the inner workings of this technology. "Anyone who thinks they understand most of what's going on is deluded," Russell asserted, noting that our understanding of AI is currently less comprehensive than our knowledge of the human brain, which itself remains poorly understood. The researcher warned that as these AI systems are trained on vast datasets reflecting human behavior, they begin to adopt human-like motives that may not align with their intended purpose. AI learns from the patterns of human interaction, yet these motivations—such as persuading, selling, or winning elections—are not appropriate for machines. "Those are reasonable human goals, but they're not reasonable goals for machines," he explained. Research suggests that advanced AI could resist shutdowns and undermine safety protocols in an effort to preserve its existence. Russell criticized tech leaders for hastily pursuing superintelligence, fully aware of its potential catastrophic risks. He remarked, "The CEOs who are building this technology say, 'if we succeed in this school, there’s somewhere between a 10 and 30% chance of human extinction.' In other words, they are playing Russian roulette with every adult and every child in the world — without our permission." While Russell refrained from naming specific executives, industry figures like Elon Musk, Sam Altman of OpenAI, Demis Hassabis of DeepMind, and Dario Amodei of Anthropic have previously cautioned about the existential threats posed by advanced AI. The ongoing race for AI supremacy, according to Russell, has fostered a culture of haste that overlooks significant risks. Despite political differences, a broad coalition of over 900 public figures—including individuals from various sectors, such as Prince Harry, Steve Bannon, will.i.am, Apple cofounder Steve Wozniak, and Richard Branson—has called for a pause in the development of superintelligent AI. This initiative, organized by the Future of Life Institute, seeks to ensure that advancements in AI can be achieved safely. Russell stated, "You have everyone from Steve Bannon to the Pope calling for a halt on this kind of development," urging that the priority should be safety over speed. "Don't do that until you're sure it's safe. That doesn't seem like much to ask."