Technology
Large Language Models Are Improving Exponentially
Source
IEEE Spectrum
Published
Similar Articles
SemiEngineering
Silent Data Corruption: A Major Reliability Challenge in Large-Scale LLM Training (TU Berlin)
Researchers at Technische Universitat Berlin published a technical paper on the challenges of Silent Data Corruption (SDC) in Large Language Model (LLM) training. As LLMs grow in size, hardware-induced faults like SDC can bypass detection mechanisms, leading to severe consequences during training. The study explores how intermittent SDC impacts LLM pretraining, highlighting the sensitivity of different factors like bit positions and kernel functions. The research proposes a lightweight detection method to identify harmful parameter updates and demonstrates the effectiveness of recomputing training steps upon detection in mitigating corruption.
SemiEngineering•
Why Thermal Metrology Must Evolve for Next-Generation Semiconductors
The whitepaper discusses the evolving thermal behavior in advanced semiconductor systems due to factors like thinner layers, higher power densities, and complex material stacks. It highlights how classical thermal assumptions break down at nanometer-scale film thicknesses and the impact on thermal conductivity and device-level modeling accuracy. The document also covers emerging architectures like 3D integration and gate-all-around transistors that reshape vertical heat flow, emphasizing the importance of accurate thermal characterization for design workflows and model validation in modern electronic systems. The guide underscores the significance of measured material properties in improving model accuracy, reducing uncertainty, and preventing costly late-stage redesigns in a thermal-first design workflow.
IEEE Spectrum•
Wafer Probe Struggles To Adapt To Multi-Die Assemblies
The article discusses the challenges faced by wafer probe processes in adapting to multi-die assemblies, especially in advanced semiconductor manufacturing. With the increasing complexity of devices like AI-class chips, wafer probe has become a critical and mechanically aggressive step. Issues such as force distribution, planarity, material behavior, and thermal effects have made wafer probe more challenging, leading to concerns about accuracy and reliability. The article highlights the need for improved force control, post-probe metrology, high-current monitoring, and careful data correlation to address these challenges and ensure yield and reliability in semiconductor manufacturing.
SemiEngineering•
3DPrint.com
After Strong Stock Run, Xometry President Sells $1.7M in Shares
The President of Xometry, a manufacturing marketplace, recently sold $1.7 million in company shares after a strong stock performance. The sale was made by the company's President, Peter Goguen, who still holds a significant number of shares in Xometry. This move comes after Xometry's successful IPO in June, where the company raised over $300 million. Goguen's sale of shares is a common practice among executives to diversify their portfolios and is not necessarily an indicator of the company's future performance.
3DPrint.com•