Aircloud Compute is now Lightyard. Aircloud continues as a private inference platformAircloud continues for inference

Hardware · NVL72

NVIDIA GB300 NVL72

A liquid-cooled rack of 72 Blackwell Ultra GPUs and 36 Grace CPUs, which we fit to a site, build into clusters and operate.

Sheet 01 · GB300 NVL7272 GPUs per rack
GPUs
72 GPUs, 36 Grace CPUs
GPU memory
20.7 TB HBM3e per rack
Network
800 Gb/s per GPU
Power
Up to 142 kW per rack
Cooling
Liquid, at the rack
Drawing is illustrative · Figures are NVIDIA's
Specifications

NVIDIA GB300 NVL72 specifications.

The figures for one rack, with what each one asks of the hall.

Generation
Blackwell Ultra
GPUs
72 GPUs per rackAll in one NVLink domain, so a single model can span the whole rack.
CPUs
36 Grace per rackOne Grace for every two GPUs.
GPU memory
288 GB HBM3e per GPU, 20.7 TB per rackA model that fits in this stays on NVLink, inside the rack.
NVLink
130 TB/s across 72 GPUs1.8 TB/s per GPU, through switch trays inside the rack.
Scale-out network
800 Gb/s per GPU (ConnectX-8)57.6 Tb/s per rack. It joins racks to each other, so it's sized to the number of racks you plan to reach.
Power
Up to 142 kW per rackNVIDIA's figure for one full rack. Network, storage and the cooling plant draw on top.
Cooling
Liquid, at the rackCold plates on the trays, through a coolant distribution unit on facility water. Some heat still goes to air.
Loaded weight
About 1.4 to 1.6 metric tonsVaries by build. We check it against the floor rating at each position.
Reference designs
2, 4 and 8 racks144, 288 and 576 GPUs. At eight racks that's up to 1,136 kW before the network.
Lead time
Set in the proposalCounted from signing. It follows rack allocation and how ready the site is.

Figures are NVIDIA's, from its GB300 NVL72 product page and reference architecture. Loaded weight is from server manufacturers' documents.

Site requirements

What one rack asks of the room.

It arrives as a single system, so its position needs the power, the water and the floor for all of it at once. The notes follow the numbers on the drawing.

  1. 1

    Up to 142 kW per rack

    Fed on two independent paths, each sized for the rack's peak. Halls built for air often fall short of that at a single position.

  2. 2

    Facility water at the position

    A coolant distribution unit, in the rack or in the row, moves heat from the cold plates to the facility loop. Power shelves and NICs still shed some heat to the air.

  3. 3

    800 Gb/s per GPU between racks

    57.6 Tb/s of ConnectX-8 links leave each rack for the leaf switches. Inside the rack, NVLink carries the GPU traffic.

  4. 4

    About 1.4 to 1.6 metric tons, loaded

    That is more than many raised floors are rated for. The dock, the lift and each doorway on the way in get checked too.

Choosing a platform

GB300 NVL72 or GB200 NVL72?

The same rack shape, NVLink domain and floor load. The difference is in memory and network per GPU, and in what each position has to feed.

GB300 NVL72 or GB200 NVL72?
GB200 NVL72GB300 NVL72
GenerationBlackwellBlackwell Ultra
GPU memory186 GB HBM3e per GPU288 GB HBM3e per GPU
Memory per rack13.4 TB per rack20.7 TB per rack
NVLink130 TB/s across 72 GPUs130 TB/s across 72 GPUs
Scale-out network400 Gb/s per GPU (ConnectX-7)800 Gb/s per GPU (ConnectX-8)
PowerAbout 120 kW per rackUp to 142 kW per rack
Loaded weightAbout 1.4 to 1.6 metric tonsAbout 1.4 to 1.6 metric tons
Reference designs8 racks2, 4 and 8 racks
Fits bestWorkloads that fit its memory, on sites already fed for itLarger models and longer context, on sites that can feed the extra draw

Figures from NVIDIA, weights from manufacturers. A position fed for GB200 may need new feeds for GB300.

Other platforms

Other NVIDIA platforms we build on.

The same four stages on each: design, source, build and operate. All hardware.

Questions

GB300 NVL72 questions.

We build GB300 NVL72 clusters as a deployment your team runs, a managed cluster you own and we operate, or a reserved cluster we own. Other platforms.

Get started

Tell us where you're starting.

Capital, hardware, a site or a team: tell us what you have and when you need it running. We usually reply within a few hours and come back with a written plan.

sales@lightyard.ai