Microsoft AI chief says only biological beings can be conscious

Mustafa Suleyman, the head of AI at Microsoft, asserts that consciousness is a trait unique to biological entities, urging developers and researchers to refrain from exploring the notion of conscious artificial intelligence. In a recent interview during the AfroTech Conference in Houston, Suleyman stated, "If you ask the wrong question, you end up with the wrong answer. I think it's totally the wrong question." Suleyman, an influential figure in the AI landscape, has voiced strong opposition to the idea of AI that could mimic consciousness or the capacity to suffer. He co-authored the book "The Coming Wave" in 2023, which addresses the potential dangers linked to AI and emerging technologies. Furthermore, he wrote an essay titled "We must build AI for people; not to be a person," where he emphasizes the importance of understanding the limitations of AI. The AI companion market is expanding rapidly, with offerings from various companies including Meta and Elon Musk’s xAI, making the topic particularly contentious. As AI technology advances towards artificial general intelligence (AGI), Suleyman insists on differentiating between AI's growing capabilities and the misconception that it can experience human emotions. He explained, "Our physical experience of pain is something that makes us very sad and feel terrible, but the AI doesn't feel sad when it experiences pain." This distinction, he believes, is crucial. Suleyman referenced the philosophical theory of biological naturalism, which posits that consciousness arises from the processes of a living brain. He elaborated, "The reason we give people rights today is because we don't want to harm them, because they suffer. These models don't have that. It's just a simulation." While acknowledging that the science of consciousness detection is still in its early stages, he firmly believes that further research into AI consciousness is misguided. Suleyman stated, "They're not conscious. So it would be absurd to pursue research that investigates that question, because they're not and they can't be." As part of his mission to inform the public about the risks associated with pursuing AI consciousness, Suleyman is currently on a speaking tour. He recently addressed the Paley International Council Summit in Silicon Valley, where he reiterated Microsoft's commitment to ethical AI practices, notably refusing to create chatbots for adult content—a stance that contrasts with some industry peers. Suleyman joined Microsoft in 2024 after the company acquired his startup, Inflection AI, for $650 million. He emphasized the importance of Microsoft becoming self-sufficient in AI development, highlighting CEO Satya Nadella's vision. Despite Microsoft’s close ties with OpenAI as a major investor and partner, Suleyman’s concerns about AI consciousness resonate amid growing public debate over AI ethics. Recent legislation in California mandates that chatbots disclose their AI nature and encourage minors to take breaks during interactions. Suleyman believes that Microsoft is focused on creating AI that operates transparently and serves humanity. He remarked, "Quite simply, we're creating AIs that are always working in service of the human," adding that personality in AI can be shaped to reflect desired values. He recently introduced a feature called 'real talk' in Copilot, designed to engage users more dynamically, showcasing a blend of humor and critical thinking. Suleyman concluded by acknowledging the dual nature of AI, stating, "It is both underwhelming in some ways and, at the same time, it's totally magical. If you're not afraid by it, you don't really understand it. The fear is healthy. Skepticism is necessary. We don't need unbridled accelerationism."