Price of Nvidia's Vera Rubin NVL72 racks skyrockets to as much as $8.8 million apiece, but server makers' margins will be tight — Nvidia is moving closer to shipping entire full-scale systems

The price of Nvidia's Vera Rubin NVL72 racks is soaring to as high as $8.8 million each, impacting both Nvidia's profits and server makers' margins. The move towards shipping complete full-scale systems is causing server makers to struggle to maintain profitability as Nvidia plans to supply partners with pre-built compute trays, taking over core design and manufacturing aspects. By delivering fully assembled tray modules, Nvidia aims to standardize the compute subsystem, potentially accounting for 90% of a server's cost and reducing the ability of server makers to differentiate and innovate beyond Nvidia's offerings. This shift may accelerate deployment timelines and reduce development costs but could also lead to decreased margins for server makers.