EP 163: Breaking the Memory Wall: Micron’s Strategy for the AI Era

This episode of The Circuit features Jeremy Werner, SVP and GM of Micron’s Core Data Center Business Unit, discussing the transformative impact of AI on the memory and storage industry. Werner explains that the industry has shifted from a traditional cyclical model to a period of sustainable growth, driven by the unique demands of AI training and inference. He highlights the emergence of a "memory wall" in inference, where massive amounts of high-speed memory and storage are required to manage expanding context windows and avoid redundant recomputation. The conversation also covers Micron's efforts to innovate across the memory hierarchy—including HBM4 and ultra-high-capacity SSDs—to solve the data center's critical bottlenecks of power and physical space.