🔥 3-day streak
NVIDIA-Certified Associate: AI Infrastructure and Operations143 / 145
Question 143 of 145

An MLOps team deploys an image classification model on Triton Inference Server. Individual client requests arrive at unpredictable intervals, each containing a single image. GPU utilization is low and per-request latency is acceptable, but overall system throughput is far below the GPU's capability. Which Triton feature should the team enable to combine multiple incoming requests into larger inference batches automatically, improving GPU utilization and throughput?

Reviewed for accuracy · Report an issueNext question