Nvidia Rethinks AI TCO: Why Cost Per Token is the Only Metric That Matters
Nvidia is shifting its focus in AI infrastructure from raw compute power to the cost per token, arguing that this metric better reflects business value and profitability. The company is also making significant investments in the physical infrastructure required for AI, including a multi-billion dollar partnership with IREN to deploy data centers and a substantial investment in Corning to expand domestic optical fiber production. These moves highlight Nvidia's strategy to control the entire AI stack, from chips to the underlying physical infrastructure, to ensure efficient and scalable AI deployments. AI
IMPACT Nvidia's focus on cost-per-token and infrastructure investments will likely drive down operational costs for AI deployments and accelerate the scaling of AI factories.