Micron Begins Sampling 256GB DDR5 RDIMMs at 9200 MT/s for AI Servers
Tags Hardware · Infrastructure
Micron has started sampling 256GB DDR5 RDIMM modules reaching speeds up to 9200 MT/s, based on 1 gamma DRAM technology with 3D stacking. The modules deliver over 40% more speed and 40% lower power than current volume modules. One 256GB module replaces two 128GB modules, reducing operating power by over 40%. Targeted at next-gen AI servers running large language models, agentic AI, and real-time inference. Sampling now to server eco-partners; validation needed before hyperscale deployment. JEDEC is moving DDR5 MRDIMM standard toward 12,800 MT/s.
Technical significance
Memory bandwidth and capacity are increasingly the bottleneck in AI inference, not compute. Micron's 256GB DDR5 modules at 9200 MT/s address both dimensions simultaneously — doubling capacity per DIMM while increasing speed 40%. The 40% power reduction per equivalent capacity is significant for AI data centers where memory power can represent 20-30% of total system power.