In this note
- What a scalable unit is
- Why SuperPODs are built from SUs
- SU size by platform
- Racks and power per SU
- Compute fabric switch and cable counts
- Storage, management and the other networks
- DGX BasePOD vs SuperPOD
- Building less than a full SU
- What a DGX SuperPOD costs
- Sizing a cluster to the workload instead of the SU
A DGX SuperPOD is NVIDIA's reference design for a whole AI cluster, built by repeating a fixed block called a scalable unit (SU). An SU is a set number of DGX systems plus the leaf switches, cabling and rack layout that go with them. On DGX H100 and B200 it's 32 systems (256 GPUs). On DGX B300 with Quantum-X800 InfiniBand it's 72 systems, and on GB200, GB300 and Vera Rubin NVL72 it's 8 racks, both 576 GPUs. NVIDIA rates one GB300 NVL72 SU at 1.2 MW.
Figures below come from NVIDIA's published reference architectures (RAs) unless we say otherwise.
What a scalable unit is
An SU is the smallest piece of a SuperPOD that NVIDIA designs and documents as one unit. It pins down the compute (a set number of DGX systems or NVL72 racks), the leaf layer of the compute fabric, and the physical layout: where the racks go, how much power each draws and how the cables run.
The leaf switches are wired rail-aligned. The same-numbered network port in every system lands on the same leaf switches, so traffic on one rail is a single switch hop from that rail on any other system in the SU. Traffic between SUs, or between rails, goes up to the spine.
Everything else is sized by how many SUs you have: the spine, the storage fabric, in-band and out-of-band Ethernet, and the control-plane servers. NVIDIA's DGX B300 RA (opens in a new tab) is written around 8 SUs (576 systems) and says the design scales "up to and beyond 72 SU with 2000+ DGX B300 nodes".
Why SuperPODs are built from SUs
NVIDIA's own reason is speed. Repeating a tested block, the GB300 RA (opens in a new tab) says, cuts deployment "from months to weeks".
For a buyer, the more useful property is that every SU has the same fabric, so a job sees the same bandwidth wherever the scheduler puts it. If the spine is planned for the final SU count, a new SU plugs into ports that already exist. And because the RAs publish switch, cable and transceiver counts per SU count, you know the network bill of materials before anyone sends a quote.
SuperPOD is also something NVIDIA sells, as well as a drawing. The RAs describe installation led by NVIDIA's installation services team, NVIDIA Mission Control for operations with Slurm or Run:ai for user access, and full-system support (compute, storage, network and software) from NVIDIA Enterprise Support. The customer owns the hardware and runs it in its own data center or a colocation site. It's designed for one tenant with many users, and the B300 RA says NVIDIA doesn't support multi-tenant modifications.
SU size by platform
| Platform (RA) | One SU | GPUs per SU | Compute fabric | Racks and power |
|---|---|---|---|---|
| DGX H100 | 32 systems | 256 | InfiniBand | Over 40 kW per rack in NVIDIA's example layout |
| DGX B200 | 32 systems | 256 | InfiniBand | Over 25 kW per rack in NVIDIA's example layout |
| DGX B300, Quantum-X800, AC power | 72 systems | 576 | 800 Gb/s XDR InfiniBand | 4 systems per rack, about 56 kW per rack, 18 compute racks |
| DGX B300, Spectrum-4, DC busbar | 64 systems | 512 | Spectrum-4 Ethernet | 4 systems per MGX busbar rack, over 50 kW per rack, 16 compute racks |
| DGX GB200 NVL72 | 8 racks | 576 | InfiniBand | Liquid and air hybrid, 1.2 MW per SU |
| DGX GB300 NVL72 | 8 racks | 576 | 800 Gb/s XDR InfiniBand | Liquid and air hybrid, 1.2 MW per SU |
| DGX Vera Rubin NVL72 | 8 racks | 576 | 800 Gb/s XDR InfiniBand, two planes | Liquid cooled, about 2 MW per SU |
| DGX Rubin NVL8 | 72 systems | 576 | 800 Gb/s XDR InfiniBand | Liquid cooled, DC busbar only |
The B300 compute rack counts are our division (72 ÷ 4 and 64 ÷ 4). NVIDIA's 8-SU bill of materials for the AC version lists 144 racks for DGX systems, 18 per SU, so it checks out. The Vera Rubin NVL72 RA marks its fabric design "subject to change", so treat those numbers as preliminary.
On Blackwell Ultra and Rubin, 576 GPUs has become the usual block, as 72 eight-GPU systems or 8 NVL72 racks. The Spectrum-4 Ethernet version of B300, at 512, is the exception.
Racks and power per SU
Facilities teams plan in SUs too. Rough figures for one:
| One SU | Compute racks | Power per compute rack | Compute power per SU | Cooling |
|---|---|---|---|---|
| DGX B300, AC | 18 | About 56 kW (NVIDIA) | About 1.0 MW (18 × 56 kW) | Air, standard EIA racks |
| DGX B300, DC busbar | 16 | Over 50 kW (NVIDIA) | Over 0.8 MW (16 × 50 kW) | MGX racks with busbar |
| GB300 NVL72 | 8 | 135 kW TDP, up to 155 kW peak (OEM) | 1.2 MW SU TDP (NVIDIA) | Direct liquid plus air |
| Vera Rubin NVL72 | 8 | Not stated per rack | About 2 MW SU TDP (NVIDIA) | Liquid |
The 1.0 MW and 0.8 MW are our multiplication and leave out the network and management racks. The GB300 per-rack figure is from an OEM's GB300 NVL72 product guide (opens in a new tab), which gives 135 kW TDP per rack and up to 155 kW peak depending on workload. Eight racks at 135 kW is 1.08 MW, which sits inside NVIDIA's 1.2 MW for the whole SU.
For GB200, GB300 and Vera Rubin NVL72, NVIDIA also says the hall should meet Uptime Institute Tier 3, TIA-942-B Rated 3 or EN 50600 Availability Class 3, with concurrent maintainability and no single point of failure. If your current room isn't built to that level, bringing it up is part of the project. Our note on building a data center for GPU clusters covers what that involves.
Compute fabric switch and cable counts
DGX B300 on Quantum-X800 InfiniBand
From the scaling table in NVIDIA's DGX B300 RA (opens in a new tab), with 144-port Quantum-X800 Q3400 switches:
| SUs | Systems | GPUs | Leaf switches | Spine switches | System-to-leaf cables | Leaf-to-spine cables |
|---|---|---|---|---|---|---|
| 1 | 72 | 576 | 8 | 4 | 576 | 576 |
| 2 | 144 | 1,152 | 16 | 8 | 1,152 | 1,152 |
| 4 | 288 | 2,304 | 32 | 18 | 2,304 | 2,304 |
| 8 | 576 | 4,608 | 64 | 36 | 4,608 | 4,608 |
| 18 | 1,296 | 10,368 | 144 | 72 | 10,368 | 10,368 |
NVIDIA's table says 9,216 GPUs in the 18-SU row. But 1,296 systems × 8 GPUs is 10,368, which matches the cable counts in the same row, so that's what we show.
Each GPU gets one 800 Gb/s link, and every link needs optics at both ends. The 8-SU bill of materials lists 4,608 transceivers on the DGX side and another 4,608 twin-port transceivers between leaf and spine. NVIDIA asks buyers to contact it for anything of 4 SUs or more.
NVL72 SuperPODs: GB200, GB300 and Vera Rubin
| SUs | GPUs | GB200 leaf / spine / core | GB300 leaf / spine | Vera Rubin leaf / spine |
|---|---|---|---|---|
| 1 | 576 | 32 / 24 per SU | 8 leaf per SU | 16 leaf per SU |
| 2 | 1,152 | 64 / 48 / 18 | 16 / 8 | 32 / 18 |
| 4 | 2,304 | 128 / 96 / 36 | 32 / 18 | 64 / 36 |
| 8 | 4,608 | 256 / 192 / 72 | 64 / 36 | 128 / 72 |
| 16 | 9,216 | 512 / 384 / 144 | 128 / 72 | Not listed |
| 18 | 10,368 | Not listed | Not listed | 288 / 144 |
The big change from GB200 to GB300 is the switch. GB200's design uses 32 leaf and 24 spine switches per SU, plus a core layer once you go past one SU. GB300 moves to 144-port Quantum-X800 switches, which brings that down to 8 leaf switches per SU (4 rails with 2 leaf switches each) and fits 16 SUs in two layers.
Vera Rubin NVL72 doubles the leaf count again. Each GPU has two ConnectX-9 adapters, split across two independent fabrics NVIDIA calls planes, so a GPU still has a path to every other GPU if one plane fails.
Storage, management and the other networks
A SuperPOD has four physical fabrics, and compute is only one of them. The other three, plus the control plane:
- Storage runs on InfiniBand or Ethernet, kept separate from compute. NVIDIA's DGX B300 guideline per SU is 80 GB/s aggregate read and 40 GB/s write at its standard level, and 250 and 124 GB/s at the enhanced level (storage architecture (opens in a new tab)). The file system comes from a storage partner certified for SuperPOD, who sizes it.
- In-band Ethernet carries provisioning, user access, the NFS tier and uplinks. NVIDIA recommends at least two 100 GbE links to the customer edge.
- Out-of-band Ethernet, on SN2201 switches, connects the management ports of every system, switch and PDU.
- The control plane in the B300 RA is seven management servers (opens in a new tab): two for Base Command Manager in high availability, three for Kubernetes and two Slurm login nodes. UFM fabric manager appliances sit alongside.
The 8-SU DGX B300 bill of materials (opens in a new tab) gives a sense of scale: 48 racks for switches and management next to the 144 compute racks (about 6 per SU), and 69 out-of-band switches.
GB300 NVL72 folds storage and in-band into one Ethernet fabric, with 4 compute-side leaf switches per SU, at least 2 storage leaf switches, and a pair each of management leaf and out-of-band spine switches.
DGX BasePOD vs SuperPOD
| DGX BasePOD | DGX SuperPOD | |
|---|---|---|
| Size | 2 to 8 DGX systems in NVIDIA's current RA | Whole SUs of 256 to 576 GPUs, up to thousands of GPUs |
| Systems | DGX B200, H200, H100 | DGX H100 through Vera Rubin NVL72 |
| Compute fabric | Two Quantum QM9700 NDR 400 Gb/s InfiniBand switches | Rail-optimized leaf and spine per SU |
| What it is | A prescriptive reference architecture | A product with a bill of materials, NVIDIA-led installation, Mission Control and full-system support |
BasePOD is for a handful of DGX systems on a validated design. Past 8 systems, the SuperPOD SU is the design NVIDIA documents.
Building less than a full SU
Plenty of clusters aren't a multiple of 72 nodes or 8 racks. The B300 RA's guidance is that "the fabric should be designed to support the full SU, including leaf-spine switches and leaf-spine cables, and leave the portion of the fabric unused where these nodes would be located." The GB300 RA says the same about leaf switches and leaf-spine cables.
Here's what that means for 32 B300 nodes (256 GPUs) against the 72-node Quantum-X800 SU:
| 32 nodes | Built for a full SU (NVIDIA guidance) | Sized to 32 nodes (estimate) |
|---|---|---|
| Leaf switches | 8 | About 4 |
| Spine switches | 4 | About 2 |
| System-to-leaf links used | 256 of 576 | 256 |
| Leaf-to-spine cables | 576 | About 256 |
| Air-cooled compute racks | 8 at about 56 kW | 8 at about 56 kW |
| Growth to 72 nodes | Add nodes and cables to the existing leaf ports | Add switches and recable the spine |
The right-sized column is our estimate for a non-blocking two-layer fabric; the real one is sized in the network design.
We'd build for the full SU if the cluster will grow during its life, because the spine is the part that's hard to change later. If the size is fixed for the whole term, size the fabric to the nodes and spend the difference on storage or spares.
Two caveats. A SuperPOD is a DGX product, so an OEM HGX B300 cluster isn't one, though it can use the same rail-aligned layout. And with NVL72 the rack is the smallest unit you can add. Four racks is half an SU, and the same guidance means planning all 8 leaf switches of a GB300 SU with only half the racks in.
What a DGX SuperPOD costs
NVIDIA doesn't publish a SuperPOD price. It's quoted per deal and includes installation, Mission Control and support.
What you can do is multiply reported rack prices by the racks in one SU. The table below is that arithmetic and nothing more: hardware only, from public reporting, not a quote and not a cost of ownership.
| One SU | Reported price per rack | Source | Hardware per SU (our arithmetic) |
|---|---|---|---|
| 8 × GB200 NVL72 | US$2.8M to US$3.4M | Tom's Hardware source, March 2026 | US$22.4M to US$27.2M |
| 8 × GB300 NVL72 | US$3.7M to US$4.0M | Loop Capital estimate, via GPUsmith | US$29.6M to US$32.0M |
| 8 × GB300 NVL72 | Just under US$5.0M | Data Gravity, purchase orders, August 2026 | Just under US$40M |
| 8 × GB300 NVL72, inference config | US$6.0M to US$6.5M | Tom's Hardware source, March 2026 | US$48M to US$52M |
| 8 × Vera Rubin NVL72 | US$5M to US$7M | Tom's Hardware source, March 2026 | US$40M to US$56M |
Reported prices swing with configuration and with who's buying. Data Gravity says its purchase-order figures are for small orders and that hyperscale buyers do better. Tom's Hardware's source warns that many quotes floating around are ODM prices without a proper warranty, and says the Vera Rubin figure includes about US$1M of storage per rack.
The all-in cost of owning an SU is much higher than the hardware line once you add the team to run it, maintenance, the months to stand it up, power and the facility. Our notes on buying or renting a GPU cluster and GPU depreciation cover those lines.
For a memo:
- One SU is 576 GPUs on DGX B300 (Quantum-X800), GB300 NVL72 and Vera Rubin NVL72, and 256 GPUs on DGX H100 and B200.
- NVIDIA rates one GB300 NVL72 SU at 1.2 MW and one Vera Rubin NVL72 SU at about 2 MW. An air-cooled DGX B300 SU is about 1 MW of compute racks.
- Hardware alone for one GB300 NVL72 SU is roughly US$30M to US$52M from public reporting, before networking, storage, facility, power and staff.
Sizing a cluster to the workload instead of the SU
A SuperPOD assumes you buy NVIDIA's product and staff the operation. We design, source, build and operate NVIDIA GPU clusters sized to the workload rather than to an SU: from 8 HGX nodes (64 GPUs) or one NVL72 rack (72 GPUs), on RoCE v2 Ethernet, spine-leaf. Most clusters are 32 to 128 nodes; larger ones are scoped case by case. Large clusters are handed over in monthly waves of 32 nodes. You can own the cluster and have us build or run it, or reserve one we hold. See cluster deployment, managed clusters, reserved clusters, the HGX B300 and GB300 NVL72 pages, or talk to us.
Questions this note answers
A scalable unit (SU) is the repeatable block a DGX SuperPOD is built from: a fixed number of DGX systems with their own leaf switches, cabling and rack layout. A DGX B300 SU is 72 systems (576 GPUs); a GB300 NVL72 SU is 8 racks (576 GPUs).
It depends on how many SUs you buy. NVIDIA's DGX B300 reference architecture is written around 8 SUs, 576 systems and 4,608 GPUs, and its GB300 and Vera Rubin NVL72 designs show up to 16 or 18 SUs in a two-layer fabric, about 9,000 to 10,000 GPUs.
BasePOD is a smaller prescriptive reference architecture; NVIDIA's current one covers 2 to 8 DGX B200, H200 or H100 systems on two InfiniBand switches. SuperPOD is a product built from whole scalable units of 256 to 576 GPUs, with NVIDIA-led installation, Mission Control and full-system support.
NVIDIA publishes no price. Multiplying reported rack prices by the racks in one SU gives roughly US$22M to US$52M of hardware for a GB200 or GB300 NVL72 SU. Owning and running one costs much more once networking, storage, power, the facility and staff are added.
NVIDIA rates a GB300 NVL72 SU at 1.2 MW and a Vera Rubin NVL72 SU at about 2 MW. An air-cooled DGX B300 SU is 18 racks at about 56 kW each, roughly 1 MW for the compute racks.
No, but NVIDIA's guidance for a smaller node count is to build the fabric for the full SU, including leaf and spine switches and leaf-to-spine cables, and leave the unused ports empty, so the cluster performs the same throughout and can grow without recabling.
Sources
- NVIDIA SuperPOD with DGX B300 and Quantum-X800 InfiniBand RA: abstract (opens in a new tab)
- NVIDIA DGX B300 Quantum-X800 RA: DGX SuperPOD architecture (opens in a new tab)
- NVIDIA DGX B300 Quantum-X800 RA: network fabrics (opens in a new tab)
- NVIDIA DGX B300 Quantum-X800 RA: storage architecture (opens in a new tab)
- NVIDIA DGX B300 Quantum-X800 RA: management servers (opens in a new tab)
- NVIDIA DGX B300 Quantum-X800 RA: bill of materials (opens in a new tab)
- NVIDIA SuperPOD with DGX B300, Spectrum-4 Ethernet and DC busbar power RA: architecture (opens in a new tab)
- NVIDIA DGX SuperPOD reference architecture with DGX GB300 (PDF) (opens in a new tab)
- NVIDIA DGX SuperPOD reference architecture with DGX Vera Rubin NVL72 (PDF) (opens in a new tab)
- NVIDIA DGX SuperPOD reference architecture: DGX GB200, architecture (opens in a new tab)
- NVIDIA DGX SuperPOD reference architecture: DGX GB200, network fabrics (opens in a new tab)
- NVIDIA DGX SuperPOD Rubin NVL8 reference architecture (May 2026) (opens in a new tab)
- NVIDIA DGX SuperPOD reference architecture: DGX B200, architecture (opens in a new tab)
- NVIDIA DGX SuperPOD reference architecture: DGX H100, architecture (opens in a new tab)
- NVIDIA DGX BasePOD reference architecture: DGX B200, H200 and H100 (opens in a new tab)
- OEM product guide: GB300 NVL72 rack-scale AI (opens in a new tab)
- GPUsmith: NVIDIA GB300 NVL72 system page (Loop Capital estimate) (opens in a new tab)
- Data Gravity: How much does an NVIDIA NVL72 cost? (August 2026) (opens in a new tab)
- Tom's Hardware: NVL72 rack prices for GB200, GB300 and Vera Rubin (March 2026) (opens in a new tab)