Micron sampling first 256GB SOCAMM2 memory packages to customers — 2TB of RAM per CPU is now in reach of datacenter players

Micron has introduced the industry's first 256GB SOCAMM2 memory units, offering a significant increase in capacity over previous modules. These new units are now being sampled to customers, enabling the possibility of having 2TB of memory per CPU. The improved density of these modules also brings a 66% increase in power efficiency compared to traditional RDIMMs, making them compatible with liquid cooling for AI servers. The collaboration between Nvidia and memory makers like Micron has led to advancements in memory capacity and power consumption, catering to the growing demands of AI data centers for enhanced performance and efficiency.