Login
Sign Up
The AI storage ecosystem is structurally defined by six distinct layers ranging from on-chip SRAM to cloud object storage, with physical proximity to computing units dictating capacity and latency characteristics. By 2025, the aggregate value of these layers, excluding embedded SRAM, is projected to reach $229 billion. Within this valuation, DRAM commands a 50% share, HBM accounts for 15%, and SSDs represent 11%. The market structure is characterized by extreme oligopoly, where the top three vendors consistently control over 90% of market share across every segment. Woofun AI analysis suggests that these profit pools diverge into three distinct categories: high-profit silicon oligopolies like HBM and QLC SSDs, high-growth interconnection segments such as CXL, and scale-driven service layers including NAS and cloud storage. The fundamental constraint driving this architecture is the limited temporary cache space of CPUs and GPUs, necessitating external memory for large model storage and inference context. Consequently, three strategic development vectors have emerged to mitigate latency and energy consumption: increasing HBM density adjacent to GPUs, implementing CXL for rack-level memory pooling, and integrating compute-storage functions on single chips.
SRAM serves as the internal cache for CPUs and GPUs, embedded directly within chips and excluded from independent trading markets valued at $1–1.7 billion. While manufacturers like Infineon, Renesas, and ISSI produce independent SRAM chips, the vast majority of revenue flows to TSMC, which produces over 70% of the world's advanced-process wafers. As AI chip generations advance, the demand for wafers accommodating additional SRAM increases, effectively capturing this value within the foundry's revenue stream. This layer remains a critical bottleneck, as its scarcity directly limits the temporary data throughput available to accelerators before external memory access is required.
HBM represents the most lucrative segment, utilizing TSV technology to vertically stack DRAM chips and package them via CoWoS next to GPUs. This architecture largely dictates the maximum model size AI accelerators can process. The market is dominated by SK Hynix, Samsung, and Micron, holding nearly 100% combined share. As of the first quarter of 2026, SK Hynix commands 57%–62% of the market, followed by Samsung at 22% and Micron at 21%. Data compiled by Woofun AI shows that the total potential HBM market is expected to grow at a compound annual growth rate of 40%, expanding from $35 billion in 2025 to $100 billion by 2028. The segment's profitability is exceptional; SK Hynix achieved a record 72% operating margin in the first quarter of 2026, surpassing TSMC's 58.1% and NVIDIA's 65%. This margin expansion is driven by TSV-induced capacity constraints on traditional DRAM, difficult yield improvements in advanced packaging, and cautious supplier expansion that pushed average selling prices up 60% in early 2026. SK Hynix's 2025 operating profit reached 47.21 trillion won, exceeding Samsung Electronics for the first time, while Micron's target price was raised to $950 by BofA in May 2026.
Motherboard DRAM, encompassing DDR5, LPDDR, GDDR, and MR-DIMM, constitutes the largest sales volume segment of the AI storage market. The global DRAM market reached approximately $121.83 billion in 2025, with Samsung leading at 36.6% share, followed by SK Hynix (including Solidigm) at 32.9% and Micron at 22.9% in the fourth quarter of 2025. Although individual product margins are lower than HBM, the sheer scale of the motherboard DRAM market ensures significant aggregate profitability. As production capacity shifts toward higher-margin HBM, the supply of conventional DRAM has tightened, maintaining strong pricing power and margins for the remaining inventory despite the lower per-unit profitability compared to stacked memory solutions.
CXL technology enables the pooling of DRAM from a single server motherboard for dynamic sharing among multiple GPUs within a rack, addressing storage shortages for KV caches and RAG indexes. The market value for CXL memory modules was $1.6 billion in 2024 but is projected to surge to $23.7 billion by 2033. While Samsung, SK Hynix, and Micron dominate the memory component, Astera Labs controls approximately 55% of the sub-market for Retimers and intelligent memory controllers connecting CXL to PCIe. In its most recent quarter, Astera Labs reported revenues of $308 million, a 93% year-on-year increase, with a non-GAAP gross margin of 76.4% and an 85% increase in net profit. This segment exemplifies the high-profit emerging layer, where specialized interconnect IP creates formidable barriers to entry and sustains exceptional margins.
Enterprise-grade NVMe SSDs serve as the primary storage for AI training checkpoints, model weights, and offloaded KV caches, with QLC SSDs fully replacing HDDs in AI data lakes. The market was valued at $26.1 billion in 2025 with a 24% CAGR, projected to reach $76 billion by 2030. Market share distribution in Q4 2025 shows Samsung at 36.9%, SK Hynix (including Solidigm) at 32.9%, Micron at 14.0%, Kioxia at 11.7%, and SanDisk at 4.4%, with the top five vendors controlling 90% of the sector. Woofun AI notes that the explosive growth of QLC SSDs, now reaching 122 TB single-disc capacity from Solidigm and Kioxia, is shifting inference storage from HBM to SSDs. While margins are lower than HBM, the combination of capacity expansion and rising inference demand creates a robust compound-interest profit layer for comprehensive platform providers like Samsung and SK Hynix.
The outermost layer comprises NAS and cloud object storage, utilized for data lakes, dataset management, and archiving. In 2025, the NAS market was valued at $39.6 billion with a 17% CAGR, while cloud object storage reached $9.1 billion with a 16% CAGR. Enterprise file storage is led by NetApp, Dell, HPE, and Huawei, whereas Synology and QNAP dominate the SME sector. In cloud IaaS, AWS holds 31%–32% share, Azure 23%–24%, and Google Cloud 11%–12%, collectively controlling 65%–70% of the market. Profitability in this segment derives from long-term hosting services, data export fees, and ecosystem lock-in effects rather than hardware margins. The industry trajectory indicates that while DRAM offers the largest market share with 30%–40% margins, HBM captures higher margins over 60% with one-third of the DRAM volume, and CXL Retimers achieve the highest margins exceeding 76% despite smaller market size. Growth is concentrated in HBM (28% CAGR), enterprise SSDs (24% CAGR), and CXL pooling (37% CAGR), with competitive barriers ranging from technical manufacturing hurdles to IP rights and switching costs.