AI Server System BOM & Rack Cost — Historical Time Series Data
Full system-level bill of materials for AI training servers — from DGX H100 (8-GPU) through GB200 NVL72 (72-GPU rack). Tracks how rack economics evolved as HBM and networking costs exploded.
AI Server System BOM & Rack Cost
Full system-level bill of materials for AI training servers — from DGX H100 (8-GPU) through GB200 NVL72 (72-GPU rack). Tracks how rack economics evolved as HBM and networking costs exploded.
Data Table
| Period | Series | Value |
|---|---|---|
DGX H100 (2023) | GPU (COGS) | 26.6 |
DGX H100 (2023) | Networking | 8 |
DGX H100 (2023) | Power & Cooling | 4 |
DGX H100 (2023) | Memory, Storage & Chassis | 6.4 |
GB200 NVL72 (2024) | GPU (COGS) | 460.8 |
GB200 NVL72 (2024) | Networking | 80 |
GB200 NVL72 (2024) | Power & Cooling | 120 |
GB200 NVL72 (2024) | Memory, Storage & Chassis | 65 |
Methodology & Sources
Synthesized from Epoch.ai hardware cost database, SemiAnalysis system architecture deep dives, and analyst estimates. All costs are approximate manufacture/procurement costs, not list prices.
Citations:
- Epoch.ai / NVIDIA DGX spec (Dec 2023)
- SemiAnalysis (Dec 2023)
- Data center analyst estimates (Dec 2023)
- Silicon Analysts estimate (Mar 2026)
- Silicon Analysts / chipSpecs.ts (Mar 2026)
- SemiAnalysis rack cost analysis (Dec 2024)
- NVIDIA NVL72 spec / Silicon Analysts (Mar 2026)
Related Tools
Related Analysis
Market intelligence on this data
All market intelligence →SK Hynix Commits $5.8B to Advanced HBM Packaging Facility; TSMC Confirms 2027 Wafer Price Hikes Up to 10%
SK Hynix packaging CapEx: +$5.8B committed; TSMC mature-node wafer price hike: up to +10% effective 2027; advanced-node pricing direction unquantified but directionally upward per Barchart/TSMC guidance.
China Eyes Export Controls on AI Chips & Models; AMD Helios Rack Enters Market with Azure Deal
Geopolitical: Potential restriction on TSMC fab access for Chinese-designed advanced chips (scope/timing unquantified); AMD Helios: Azure H2 2026 deployment commitment (unit volume undisclosed).
TSMC Commits $100B+ Arizona Expansion, Accelerates 3nm Conversion to Meet AI Chip Surge
Capacity: TSMC U.S. CapEx raised by +$100B incremental; total U.S. commitment reaches ~$265B per Odaily/Reuters; annual CapEx guidance lifted to $60–64B. 5nm-to-3nm fab conversion timeline accelerated (no specific % capacity figure disclosed publicly).
TSMC $265B US CapEx Commitment + ASML 30% EUV Capacity Surge Signal Multi-Year AI Supply Expansion — with Equipment Price Hike Risk
TSMC CapEx: +$100B incremental US commitment (total $265B), 2026 CapEx at high end of $52–56B range; ASML EUV/DUV capacity: +30% per year for 2 years; ASML 2026 revenue guidance raised ~15–19% vs prior midpoint (€38B → €44B midpoint); ASML EUV price hike quantum not yet disclosed — wafer/packaging cost pass-through risk flagged but unquantified.