China's DeepSeek kicked off 2026 with a new AI training method that analysts say is a 'breakthrough' for scaling

China's DeepSeek kicked off 2026 with a new AI training method that analysts say is a 'breakthrough' for scaling

DeepSeek, a prominent Chinese AI startup, has kicked off the year with an innovative approach to training artificial intelligence that analysts are calling a 'significant breakthrough.' The company released a research paper on Wednesday detailing their new method for training large language models, which they believe could redefine the trajectory of foundational AI models. The paper, co-authored by founder Liang Wenfeng, introduces a novel technique known as "Manifold-Constrained Hyper-Connections" (mHC). This approach allows for enhanced internal communication within models while maintaining stability and computational efficiency as models scale. In the context of growing language models, researchers traditionally attempt to boost performance by enabling different components of a model to share information more freely. However, this often leads to instability. DeepSeek's latest findings suggest that by constraining how models share this information, they can achieve richer interactions without compromising stability. Wei Sun, principal analyst for AI at Counterpoint Research, praised the new methodology, describing it as a 'striking breakthrough.' She emphasized that DeepSeek's approach cleverly combines various techniques to reduce the costs typically associated with training models. Despite a slight increase in costs, the potential for enhanced performance is substantial. Sun noted that the publication reflects DeepSeek's internal capabilities and their commitment to merging rapid experimentation with innovative research ideas. This advancement could allow DeepSeek to overcome computational bottlenecks and achieve significant leaps in AI intelligence, reminiscent of their 'Sputnik moment' in January 2025 when they launched their R1 reasoning model, which notably challenged established competitors. Lian Jye Su, chief analyst at technology research firm Omdia, stated that DeepSeek's research could influence the broader industry, inspiring rival AI labs to explore similar methodologies. He remarked on the company's willingness to share important findings, indicating a newfound confidence within the Chinese AI sector. As DeepSeek gears up for the anticipated launch of its next flagship model, R2, the timing of this paper is noteworthy. Initially expected in mid-2025, the launch has faced delays due to performance issues and shortages of advanced AI chips, which have complicated the development and deployment of cutting-edge models in China. While the paper does not specifically mention R2, its release has raised questions, especially given DeepSeek's history of publishing foundational research ahead of significant model launches. Analysts believe that the novel architecture introduced could play a critical role in DeepSeek's future developments, although some remain cautious about the timeline and the potential for a standalone R2 model given recent updates to their existing R1 model.

Sources : Business Insider

Published On : Jan 02, 2026, 07:15

Computing
Market Turbulence: Four Key Factors Impacting Stocks This Week

This past week has been challenging for the stock market, driven by several significant forces that have created turbule...

CNBC | Jul 25, 2026, 20:05
Market Turbulence: Four Key Factors Impacting Stocks This Week
Cybersecurity
The Aluminum Foil Trend: A DIY Shield Against Wireless Identity Theft

Have you noticed an unusual trend where people are wrapping their wallets in aluminum foil? This peculiar practice has e...

Business Today | Jul 25, 2026, 02:45
The Aluminum Foil Trend: A DIY Shield Against Wireless Identity Theft
Startups
AI Transformations Lead to Major Job Cuts at Tech Giants

Monday.com, the innovative work management platform based in Tel Aviv, has recently announced significant layoffs, attri...

TechCrunch | Jul 26, 2026, 01:45
AI Transformations Lead to Major Job Cuts at Tech Giants
Startups
The Boring Company Eyes $4 Billion Funding Boost Amid Expanding Tunnel Ventures

Elon Musk's tunneling enterprise, The Boring Company, is reportedly negotiating a substantial funding round of $4 billio...

TechCrunch | Jul 25, 2026, 19:50
The Boring Company Eyes $4 Billion Funding Boost Amid Expanding Tunnel Ventures
Mobile
Unleashing the Power of AI: The 5 Smartphones Redefining Mobile Photography

Artificial Intelligence (AI) is transforming our daily experiences, permeating various aspects of technology, including ...

Business Today | Jul 26, 2026, 07:05
Unleashing the Power of AI: The 5 Smartphones Redefining Mobile Photography
View All News