China's DeepSeek kicked off 2026 with a new AI training method that analysts say is a 'breakthrough' for scaling

China's DeepSeek kicked off 2026 with a new AI training method that analysts say is a 'breakthrough' for scaling

DeepSeek, a prominent Chinese AI startup, has kicked off the year with an innovative approach to training artificial intelligence that analysts are calling a 'significant breakthrough.' The company released a research paper on Wednesday detailing their new method for training large language models, which they believe could redefine the trajectory of foundational AI models. The paper, co-authored by founder Liang Wenfeng, introduces a novel technique known as "Manifold-Constrained Hyper-Connections" (mHC). This approach allows for enhanced internal communication within models while maintaining stability and computational efficiency as models scale. In the context of growing language models, researchers traditionally attempt to boost performance by enabling different components of a model to share information more freely. However, this often leads to instability. DeepSeek's latest findings suggest that by constraining how models share this information, they can achieve richer interactions without compromising stability. Wei Sun, principal analyst for AI at Counterpoint Research, praised the new methodology, describing it as a 'striking breakthrough.' She emphasized that DeepSeek's approach cleverly combines various techniques to reduce the costs typically associated with training models. Despite a slight increase in costs, the potential for enhanced performance is substantial. Sun noted that the publication reflects DeepSeek's internal capabilities and their commitment to merging rapid experimentation with innovative research ideas. This advancement could allow DeepSeek to overcome computational bottlenecks and achieve significant leaps in AI intelligence, reminiscent of their 'Sputnik moment' in January 2025 when they launched their R1 reasoning model, which notably challenged established competitors. Lian Jye Su, chief analyst at technology research firm Omdia, stated that DeepSeek's research could influence the broader industry, inspiring rival AI labs to explore similar methodologies. He remarked on the company's willingness to share important findings, indicating a newfound confidence within the Chinese AI sector. As DeepSeek gears up for the anticipated launch of its next flagship model, R2, the timing of this paper is noteworthy. Initially expected in mid-2025, the launch has faced delays due to performance issues and shortages of advanced AI chips, which have complicated the development and deployment of cutting-edge models in China. While the paper does not specifically mention R2, its release has raised questions, especially given DeepSeek's history of publishing foundational research ahead of significant model launches. Analysts believe that the novel architecture introduced could play a critical role in DeepSeek's future developments, although some remain cautious about the timeline and the potential for a standalone R2 model given recent updates to their existing R1 model.

Sources : Business Insider

Published On : Jan 02, 2026, 07:15

Automotive
AI Revolutionizes Aerodynamics in Motorsport: A New Era of Design

Since the mid-1960s, the introduction of aerodynamic wings revolutionized racing cars, shifting the focus from merely re...

Ars Technica | Apr 30, 2026, 15:40
AI Revolutionizes Aerodynamics in Motorsport: A New Era of Design
Startups
Jim Cramer Highlights Two Stocks Worth Investing In Following Big Tech Earnings Reports

In the wake of a bustling night featuring earnings reports from major technology companies, financial commentator Jim Cr...

CNBC | Apr 30, 2026, 15:15
Jim Cramer Highlights Two Stocks Worth Investing In Following Big Tech Earnings Reports
Computing
Microsoft Unveils Historic Early DOS Source Code to the Public

In a remarkable move, Microsoft has opened the vault on its computing history by releasing what it describes as 'the ear...

Ars Technica | Apr 30, 2026, 14:25
Microsoft Unveils Historic Early DOS Source Code to the Public
Startups
Sam Altman Questions the Future of Universal Basic Income Amid AI Concerns

Sam Altman, the CEO of OpenAI, has shifted his stance on universal basic income (UBI), a concept he once championed. Dur...

Business Insider | Apr 30, 2026, 13:25
Sam Altman Questions the Future of Universal Basic Income Amid AI Concerns
Computing
Jim Cramer Critiques Microsoft's Latest Earnings Report

In a recent analysis, financial commentator Jim Cramer expressed his dissatisfaction with the earnings results released ...

CNBC | Apr 30, 2026, 16:20
Jim Cramer Critiques Microsoft's Latest Earnings Report
View All News