Nvidia memo says Capital One discussed alternatives to AWS as AI costs could 'get out of hand'

An internal memo from Nvidia has unveiled that Capital One is exploring options beyond Amazon Web Services (AWS) due to escalating costs associated with AI infrastructure. The document, accessed by Business Insider, indicates that a representative from Nvidia discussed these concerns with Capital One during a recent technology conference. The Nvidia employee noted in the email that Capital One is increasingly aware of its growing needs for GPUs and AI reasoning models, expressing that costs related to AWS could 'get out of hand.' This situation highlights a broader trend among companies racing to adopt generative AI while simultaneously trying to manage rising cloud expenses. Nvidia and Capital One have been in discussions about establishing an 'AI factory'—a dedicated in-house data center designed for training and running AI models, which could serve as a cost-effective alternative to third-party cloud services. Such infrastructure is crucial for financial tasks, including fraud detection and algorithmic trading. Additionally, the memo references 'neo-clouds,' which are emerging cloud providers that utilize Nvidia hardware and primarily focus on AI workloads. Unlike AWS, which caters to a diverse array of computing needs, these neo-clouds offer tailored solutions. Notable players in this space include CoreWeave, Lambda, Crusoe, and Nebius. As Capital One evaluates its cloud spending, it reflects a critical pattern in the AI landscape—companies are increasingly assessing their reliance on established cloud providers. A recent report from RBC Capital revealed that 43% of companies utilize more than two public cloud providers, highlighting a shift in strategy. Despite these considerations, a Capital One spokesperson affirmed the bank's commitment to AWS as its main cloud partner. An AWS representative responded, emphasizing their ongoing efforts to lower prices while maintaining service quality, arguing that the company continues to be a preferred choice for startups. The memo signifies a growing concern among various companies regarding AWS costs, with reports indicating that many AI startups are opting for rival cloud services to avoid traditional AWS expenses. As the demand for neo-cloud providers rises, it remains to be seen how companies will navigate the complexities of AI development and cloud spending moving forward.