Question

A data center architect is comparing the intra-node GPU interconnect of an NVIDIA DGX H100 system against an older DGX A100 system to justify an upgrade for large-scale model training. She needs to explain to management the primary technical advantage of the newer system's scale-up fabric between the eight GPUs inside a single node. Which statement best describes the key improvement?

Accepted Answer

The DGX H100 uses fourth-generation NVLink and third-generation NVSwitch, providing significantly higher per-GPU NVLink bandwidth for all-to-all GPU communication than the DGX A100

Answer

The DGX H100 replaces NVLink entirely with PCIe Gen5, which delivers higher aggregate bandwidth than any NVLink generation

Answer

The DGX H100 uses InfiniBand NDR between the eight internal GPUs instead of NVLink to reduce switch complexity

Answer

The DGX H100 improves interconnect speed only by increasing system DRAM capacity, leaving the GPU-to-GPU fabric unchanged from the A100