Nvidia demonstrates Rubin Ultra tray, the world's first AI GPU with 1TB of HBM4E memory — new chips will slot into Kyber racks

Nvidia showcased its upcoming Rubin Ultra tray, the first AI GPU with 1TB of HBM4E memory, set to launch in 2027. This new GPU platform will utilize the Kyber rack design, integrating 144 GPU packages for enhanced performance compared to current models. The Rubin Ultra package features four compute chiplets and a new packaging technology, potentially stacked for efficiency. The Kyber rack will also introduce liquid cooling and a 7th Generation NVLink switch to accommodate more GPUs, promising significant performance improvements.