The Sins of the Past
THE MEMORY WARS.
Where Did All the Memory Go?
The answer is both simple and maddening: the hyperscalers took it. Companies like Microsoft, Google, Amazon, and Meta are deploying AI infrastructure at a scale that was, until recently, almost impossible to comprehend. Each AI GPU cluster requires not just raw compute — it requires enormous quantities of High-Bandwidth Memory (HBM), a stacked, ultra-fast memory architecture that enables the data throughput AI models demand.
The three companies that control over 95% of global DRAM production — Micron, SK Hynix, and Samsung — are not charities. When AI chip manufacturers came knocking with orders for HBM at $60 to $100 per module, compared to the $5 to $10 a conventional DDR5 module fetches, the math was obvious. Production lines were retooled. Consumer memory was deprioritized. And the ripple effects are now everywhere.
It gets worse. The production process for HBM is extraordinarily complex — Micron stacks 12 to 16 layers of memory dies into a single cube-like package. This isn't a matter of turning a dial; retooling a fab for HBM production takes months and billions of dollars. And in the meantime, consumer DDR5 and GDDR7 supplies have dwindled to critical levels.
The Sins of the Past
This crisis did not appear from nowhere. The memory industry planted these seeds years ago during the 2022–2023 downturn, when post-pandemic demand collapsed and DRAM prices cratered. Samsung, facing catastrophic losses, cut production by roughly 50%. The entire industry slashed capital expenditure and built essentially no new fab capacity through most of 2024 and into early 2025.
It was a rational response to a cyclical bust. It was also a catastrophic miscalculation about what was coming.
-
2022-23 • Indusrty Cuts Production
Samsung cuts output ~50%. CapEx across all three DRAM makers falls to multi-year lows. No new fabs are ordered. -
Mid-2025 • AI Demand Surges
Hyperscaler GPU deployments accelerate. HBM demand spikes. Manufacturers begin reallocating consumer DRAM capacity. -
Oct-Dec 2025 • Prices Explode
DDR5 contract prices rise ~300% in three months. Japanese retailers introduce purchase limits. NVIDIA quietly plans GPU production cuts. -
Q1 2026 • Crisis Goes Mainstream
DRAM prices rise another 90% quarter-over-quarter. Dell, ASUS, Acer announce price hikes. PC and smartphone market forecasts sharply revised downward. -
2027-28 • New Fabs Come Online
Micron's Idaho and New York facilities begin volume production. Analysts expect partial price relief — but baseline pricing stays elevated.
When AI demand surged in mid-2025, the industry had no capacity buffer. The fabs that should have been ordered in 2023 won't be online until 2027 or 2028 at the earliest. That is an immovable timeline — you cannot rush semiconductor fab construction.
What This Means for Consumers
The 16GB tier — already borderline for demanding modern titles — is thinning out. The path to an affordable 16GB card is narrowing precisely when software demands make it most necessary.
AI PCs — which require 16GB of RAM minimum for Microsoft's Copilot+ certification — are arriving just as RAM becomes prohibitively expensive to include. The industry is being forced to ship less memory into devices that need more of it, at exactly the wrong moment.
When Does It End?
Even when new capacity arrives, it may not deliver the price relief consumers hope for. AI demand is also growing — at roughly 20–30% annually, by most estimates. Supply expansion may simply keep pace with consumption rather than outpace it. IDC's analysts are cautious: "the end of an era of cheap, abundant memory" may be a structural shift, not a temporary shock.
Some alternatives are emerging. XPUs — custom accelerators from Google (TPUs), Amazon (Trainium), and Intel (Gaudi) — are gaining traction as organizations seek GPU alternatives. About 31% of enterprises are now evaluating TPUs and 26% are evaluating Trainium, according to a recent survey. These chips diversify the compute supply chain, but they don't solve the underlying memory constraint: they, too, need HBM.
For now, the consumer sits at the bottom of the allocation stack. AI companies are first in line. Server makers are second. Consumer GPU and PC makers get what's left. And what's left, increasingly, isn't much.
If you need RAM today, the best advice from industry insiders is blunt: buy it now, before the next wave of price increases arrives. The shortage is expected to deteriorate further before it improves. The fabs are coming — but the machine doesn't care about your upgrade plans.
"Because our demand is so high, every HBM supplier is gearing up, and they're all doing great."
— Jensen Huang, NVIDIA CEO, CES 2026
"Consumers shouldn't wait for their PC upgrades — the situation is expected to deteriorate further."
— Wallace Santos, MAINGEAR CEO