🔥 3-day streak
NVIDIA-Certified Associate: AI Infrastructure and Operations82 / 145
Question 82 of 145

A research team is deploying a 16-node GPU cluster to train a large language model. Each node contains 8 GPUs connected internally by NVLink and NVSwitch. During distributed training, gradient synchronization traffic between nodes is becoming a bottleneck, and the team observes GPUs sitting idle while waiting on cross-node communication. Which networking technology should they adopt between nodes to minimize this communication overhead for the multi-node training job?

Reviewed for accuracy · Report an issueNext question