Technology

A Fundamental Rethinking Of Memory Hierarchy Design (Stanford University)

Source

SemiEngineering

Published

Sep 5, 2025

TL;DR

AI Generated

Researchers at Stanford University and an independent researcher published a technical paper titled "The Future of Memory: Limits and Opportunities," proposing a new memory hierarchy design. They suggest breaking memory into smaller slices tightly coupled with compute elements instead of large shared memories, addressing challenges of scaling and signaling. Leveraging 2.5D/3D integration, this design enables private local memory for faster data access and reduced costs. In-package memory elements provide better bandwidth and energy efficiency compared to DRAM, allowing for efficient data placement and movement. The proposed hardware-software approach aims to optimize memory performance and overcome current limitations.

Read Full Article

Ambitious hacker reduces worst-case memory latency by up to 93%, but with severe downsides — 1960s bottleneck overcome by hedging memory accesses to avoid running into DRAM refresh stalls

A hacker named LaurieWired developed a method called TailSlayer to reduce memory latency by up to 93% by avoiding DRAM refresh stalls. By duplicating the working set across memory addressing boundaries and running operations simultaneously on different CPU cores, she achieved significant latency reductions on consumer and server hardware. Her technique is particularly beneficial for sensitive workloads like high-frequency trading, where deterministic memory latency is crucial. However, the method requires duplicating the working set for each memory channel, leading to increased memory requirements that may limit its applicability to certain use cases. LaurieWired's detailed video and GitHub repository provide further insights into her innovative approach.

Tom's Hardware•

3 weeks ago

Microsoft once tried to cut Windows 11 RAM usage, install size by 20%, now it’s trying again in 2026

Microsoft had a project in the past to reduce Windows 11 RAM usage by 20%, but it was never completed. Now, in 2026, Microsoft is revisiting this goal to improve performance, responsiveness, and memory efficiency. The high RAM usage in Windows 11 is attributed to background services, web-based apps, and a fragmented UI stack. Microsoft is now focusing on reducing memory footprint, improving responsiveness under load, and moving components toward native frameworks like WinUI3. With increased public scrutiny and market pressure, Microsoft aims to address performance issues in Windows 11 more effectively than in the past.

Windows Latest•

2 months ago

Dr. L.C. Lu on TSMC Advanced Technology Design Solutions

Dr. L.C. Lu, a key figure at TSMC, focuses on design-technology co-optimization, packaging innovations, and AI-driven methodologies for next-gen semiconductor systems. TSMC emphasizes DTCO and DDCL innovations for scaling from N5 to A14 nodes, with NanoFlex and NanoFlex Pro architectures offering efficiency gains. N2P and N2U nodes incorporate advanced DTCO and power delivery optimizations, with hybrid dual-rail architectures achieving significant energy savings. TSMC collaborates with EDA partners for AI integration, enhancing productivity and design quality. Advanced packaging technologies like CoWoS and SoIC play a crucial role in enabling AI scaling, with memory bandwidth and interconnect performance scaling aggressively. TSMC addresses power delivery and thermal management challenges in AI systems through advanced solutions. TSMC's advancements in design methodologies and AI-driven automation promise improved productivity and scalability in chip-package co-design.

SemiWiki•

8 hours ago

MindsEye's sabotage mission is being slammed as dull and pointless

Build A Rocket Boy accuses individuals of sabotaging MindsEye's launch, spending over €1 million on damaging efforts. The studio integrates the controversy into a new in-game mission, Blacklist, to showcase evidence of sabotage to players. However, reports describe the mission as lackluster and failing to deliver a compelling narrative. Critics attribute the launch issues to internal problems, such as management and design decisions, casting doubt on the sabotage claims. The saga continues as MindsEye's post-launch turmoil unfolds.

TweakTown•