Tech News
Back to home
Technology

Power Stabilization To Allow Continued Scaling Of AI Training Workloads (Microsoft, OpenAI, NVIDIA)

Source

SemiEngineering

Published

TL;DR

AI Generated

Researchers from Microsoft, OpenAI, and NVIDIA have published a technical paper on "Power Stabilization for AI Training Datacenters" addressing power management challenges in large AI training workloads involving tens of thousands of GPUs. The paper discusses the power variability during training, the impact of compute-heavy phases on power consumption, and the potential risks to power grid infrastructure. To enable safe scaling of AI training workloads, the paper explores solutions at the software, GPU hardware, and datacenter infrastructure levels. The proposed solutions were tested using real hardware and Microsoft's cloud power simulator to evaluate their effectiveness in real-world scenarios.

Read Full Article

Similar Articles

Voyager 1 gets emergency instrument shutdown to solve escalating power crisis and give it ‘about a year of breathing room’ — interstellar spacecraft's nuclear power source is dying, leading to intensifying countermeasures

Voyager 1 gets emergency instrument shutdown to solve escalating power crisis and give it ‘about a year of breathing room’ — interstellar spacecraft's nuclear power source is dying, leading to intensifying countermeasures

NASA's Voyager 1 spacecraft faces a power crisis as its nuclear power source dwindles, prompting an emergency shutdown of the Low-energy Charged Particles experiment to conserve power. The aging radioisotope thermoelectric generator (RTG) onboard is losing power annually, with estimates suggesting it has around 57% of its original capacity left. To extend Voyager 1's mission, engineers are planning an energy-efficient upgrade called "the Big Bang" that involves replacing power-hungry devices with lower-power alternatives. If successful, this fix could potentially allow Voyager 1 to continue its mission beyond its expected retirement date.

Tom's Hardware•
3DPrint.com

Our Industry’s Shipping Container Moment

The article discusses the concept of a "shipping container moment" in the tech industry, drawing parallels to the impact that standardized shipping containers had on global trade. It highlights how certain technologies, like cloud computing and APIs, are becoming foundational elements that enable innovation and transformation across various sectors. The article emphasizes the importance of these technologies in driving efficiency, scalability, and interoperability in modern business operations. It suggests that embracing these foundational technologies can lead to significant advancements and disruptions in the tech landscape.

3DPrint.com•
Report claims Arm chips will power 90% of AI servers based on custom processors in 2029 — x86 and RISC-V on the outside looking in

Report claims Arm chips will power 90% of AI servers based on custom processors in 2029 — x86 and RISC-V on the outside looking in

Arm chips are predicted to dominate AI servers by 2029, with 90% of servers using custom processors based on the Arm ISA. This shift is driven by the cost and power efficiency of Arm-based CPUs tailored for AI workloads, leading major cloud service providers like AWS, Google, and Microsoft to develop their own Arm-based processors. While x86 processors have traditionally dominated general-purpose servers, the rise of custom Arm CPUs signals a significant transition in the AI server market. AMD and Intel are also developing custom CPUs optimized for AI workloads to stay competitive in this evolving landscape.

Tom's Hardware•
Nvidia's 16-pin time bomb could be defused by this $95 gadget — Ampinel offers load balancing that Nvidia forgot to include

Nvidia's 16-pin time bomb could be defused by this $95 gadget — Ampinel offers load balancing that Nvidia forgot to include

A new device called Ampinel by Aqua Computer aims to prevent 16-pin power connector meltdowns in Nvidia graphics cards by offering active current balancing. This device monitors and regulates the current flow in real-time across the six 12V power lines within the connector. It features visual and auditory alarms, an OLED display, and customizable presets through Aquasuite software. The Ampinel is priced at €79.90 or $93.58 and is set to be available for preorder soon, with delivery expected to start in mid-November. Aqua Computer may also release a white version of the device in the future.

Tom's Hardware•

We use cookies

We use cookies to ensure you get the best experience on our website. For more information on how we use cookies, please see our cookie policy.