Question

An infrastructure architect is documenting the internal specifications of a new DGX H100 system for the operations team. A colleague asks what role the two host CPUs play in the system, given that the eight H100 GPUs perform the actual deep learning computation. Which statement BEST describes the primary function of the host CPUs in this configuration?

Accepted Answer

They orchestrate the system, run the OS, manage data loading and preprocessing, and feed batches to the GPUs, rather than performing the core tensor math.

Answer

They execute the matrix multiplications for training in parallel with the GPUs to increase overall FLOPS.

Answer

They provide the high-bandwidth memory (HBM) that the GPUs use to store model weights during training.

Answer

They handle the all-to-all GPU collective communication that would otherwise require NVSwitch.