🔥 3-day streak
NVIDIA-Certified Associate: AI Infrastructure and Operations108 / 145
Question 108 of 145

A machine learning engineer is distributing a large training job across all 8 GPUs in a single DGX server. The framework must efficiently perform all-reduce operations to synchronize gradients between GPUs after each step, automatically taking advantage of the server's NVLink and NVSwitch topology. Which NVIDIA software component is specifically designed to provide these optimized multi-GPU collective communication primitives?

Reviewed for accuracy · Report an issueNext question