Question

A data center operations team is preparing to install a single NVIDIA DGX H100 system (8x H100 SXM GPUs) into an existing rack. The facility's power and cooling team asks the AI infrastructure engineer what the most important electrical planning consideration is for this node. Which statement best reflects the correct planning approach for a DGX H100?

Accepted Answer

A DGX H100 draws roughly 10 kW at peak, so the rack must be provisioned with sufficient high-density power distribution and cooling to sustain it, not just standard office-server circuits.

Answer

A DGX H100 runs entirely on a single standard 120V/15A wall outlet, so no special power distribution planning is needed.

Answer

Power planning is unnecessary because the H100 GPUs automatically underclock to stay within a 1.5 kW node budget regardless of workload.

Answer

The dominant electrical concern is the InfiniBand switch power, since the DGX node itself consumes under 2 kW during training.