In a first, Google has released data on how much energy an AI prompt uses
Source
Published
TL;DR
AI GeneratedGoogle has released a technical report revealing that the median energy consumption of its Gemini AI apps for a single query is 0.24 watt-hours, equivalent to running a microwave for one second. The report offers insights into water consumption and carbon emissions associated with AI prompts. The study highlights the energy demand breakdown, showing that AI chips account for 58% of the total electricity demand, with other infrastructure components also playing significant roles. Google's transparency in sharing this data is seen as a significant step in understanding AI energy usage, with experts praising the comprehensive analysis provided. The company's efforts to optimize energy efficiency in AI models have led to a significant reduction in energy consumption over time.