Anthropic is accusing China's Alibaba of exploiting its AI models in a large-scale attack

In a significant development within the tech industry, Anthropic has leveled serious allegations against Alibaba, one of China's leading technology firms, claiming that it has engaged in a large-scale exploitation of its AI models. Sarah Heck, Anthropic's head of policy, detailed these accusations in a letter addressed to South Carolina Senator Tim Scott and Massachusetts Senator Elizabeth Warren on June 10. Heck's correspondence highlighted that Alibaba had recently executed what she described as the "largest known distillation attack" on Anthropic's systems. During the period from April 22 to June 5, Heck stated that operators associated with Alibaba conducted a staggering 28.8 million interactions with Anthropic's AI model, Claude, using nearly 25,000 fraudulent accounts to illicitly extract its capabilities for their own AI training purposes. Distillation attacks are a technique where advanced AI models are utilized to enhance the performance of less sophisticated models, enabling firms to circumvent the extensive training and research costs typically associated with developing cutting-edge AI technologies. Heck expressed her concerns that such attacks could accelerate the development of Chinese AI models, enabling them to reach capabilities akin to Anthropic's advanced Claude Mythos model more rapidly. The Mythos model is recognized for its exceptional ability to identify software vulnerabilities and its superiority in cybersecurity tasks compared to human performance. In her letter, Heck urged lawmakers to consider new regulations aimed at curbing these distillation attacks. She proposed measures that would restrict access to advanced U.S. computing resources for Chinese entities and impose penalties on those who engage in such exploitative practices. This letter comes on the heels of recent actions by the U.S. government, which has imposed export controls on Anthropic's latest model, Fable 5, preventing foreign individuals from accessing it due to national security concerns. The situation is further complicated for Alibaba, as it has recently been added to a Pentagon blacklist associated with businesses tied to the Chinese military. In response to its designation, Alibaba has filed a lawsuit against the U.S. government. As of the latest reports, Alibaba's stock has seen a decline of over 4%. Representatives from Alibaba have not commented on these allegations.