🔥 3-day streak
Professional Machine Learning Engineer61 / 166
Question 61 of 166

Your team serves a TensorFlow image-classification model on a Vertex AI endpoint. A high-volume internal microservice sends millions of prediction requests per hour and is experiencing significant per-request serialization overhead and connection setup latency. The payloads are large tensor arrays. You want to reduce serving latency and increase throughput between the client and the model server without changing the model itself. Which change should you prioritize?

Reviewed for accuracy · Report an issueNext question