AI Server System BOM & Rack Cost — Historical Time Series Data
Full system-level bill of materials for AI training servers — from DGX H100 (8-GPU) through GB200 NVL72 (72-GPU rack). Tracks how rack economics evolved as HBM and networking costs exploded.
AI Server System BOM & Rack Cost
Full system-level bill of materials for AI training servers — from DGX H100 (8-GPU) through GB200 NVL72 (72-GPU rack). Tracks how rack economics evolved as HBM and networking costs exploded.
Data Table
| Period | Series | Value |
|---|---|---|
DGX H100 (2023) | GPU (COGS) | 26.6 |
DGX H100 (2023) | Networking | 8 |
DGX H100 (2023) | Power & Cooling | 4 |
DGX H100 (2023) | Memory, Storage & Chassis | 6.4 |
GB200 NVL72 (2024) | GPU (COGS) | 460.8 |
GB200 NVL72 (2024) | Networking | 80 |
GB200 NVL72 (2024) | Power & Cooling | 120 |
GB200 NVL72 (2024) | Memory, Storage & Chassis | 65 |
Methodology & Sources
Synthesized from Epoch.ai hardware cost database, SemiAnalysis system architecture deep dives, and analyst estimates. All costs are approximate manufacture/procurement costs, not list prices.
Citations:
- Epoch.ai / NVIDIA DGX spec (Dec 2023)
- SemiAnalysis (Dec 2023)
- Data center analyst estimates (Dec 2023)
- Silicon Analysts estimate (Mar 2026)
- Silicon Analysts / chipSpecs.ts (Mar 2026)
- SemiAnalysis rack cost analysis (Dec 2024)
- NVIDIA NVL72 spec / Silicon Analysts (Mar 2026)
Related Tools
Related Analysis
Market intelligence on this data
All market intelligence →Nvidia-SK Hynix & Samsung-Broadcom Lock In $950B HBM Supply Agreements, Securing Next-Gen Memory Pipeline Through 2030
SK Hynix: $750B long-term HBM supply commitment to U.S. customers (led by Nvidia); Samsung: $200B memory + foundry + packaging commitment to Broadcom through 2030; SK Telecom 2GW AI data center powered by HBM4 targeting 2027 online date; TSMC CoWoS and advanced packaging capacity described as largely booked through 2027.
SK Hynix Commits $5.8B to Advanced HBM Packaging Facility; TSMC Confirms 2027 Wafer Price Hikes Up to 10%
SK Hynix packaging CapEx: +$5.8B committed; TSMC mature-node wafer price hike: up to +10% effective 2027; advanced-node pricing direction unquantified but directionally upward per Barchart/TSMC guidance.
China Eyes Export Controls on AI Chips & Models; AMD Helios Rack Enters Market with Azure Deal
Geopolitical: Potential restriction on TSMC fab access for Chinese-designed advanced chips (scope/timing unquantified); AMD Helios: Azure H2 2026 deployment commitment (unit volume undisclosed).
TSMC Commits $100B+ Arizona Expansion, Accelerates 3nm Conversion to Meet AI Chip Surge
Capacity: TSMC U.S. CapEx raised by +$100B incremental; total U.S. commitment reaches ~$265B per Odaily/Reuters; annual CapEx guidance lifted to $60–64B. 5nm-to-3nm fab conversion timeline accelerated (no specific % capacity figure disclosed publicly).