Cooling system for a single Nvidia Blackwell Ultra NVL72 rack costs a staggering $50,000 — set to increase to $56,000 with next-generation NVL144 racks

The liquid cooling system for a single Nvidia Blackwell Ultra NVL72 rack is priced at $50,000, with the cost expected to rise to $56,000 for the next-generation NVL144 racks due to increased power demands from GPUs and switches. The cooling components for the NVL72 rack include high-performance cold plates for CPUs and GPUs, costing $300 per unit, and for NVSwitch ASICs, costing $200 per unit. As Nvidia transitions to more powerful GPUs like the Rubin Ultra GPUs with a TDP of 3,600W, the need for advanced cooling solutions like immersion or embedded cooling becomes necessary, driving up costs. The upcoming liquid-cooled NVL576 'Kyber' rack-scale solution is anticipated to double performance but will come with higher thermal draw and increased cooling system costs.