🔥 3-day streak
NVIDIA-Certified Associate: AI Infrastructure and Operations82 / 145
Question 82 of 145
A research team is deploying a 16-node GPU cluster to train a large language model. Each node contains 8 GPUs connected internally by NVLink and NVSwitch. During distributed training, gradient synchronization traffic between nodes is becoming a bottleneck, and the team observes GPUs sitting idle while waiting on cross-node communication. Which networking technology should they adopt between nodes to minimize this communication overhead for the multi-node training job?
Reviewed for accuracy · Report an issueNext question