Question

A machine learning engineer operates a real-time SageMaker endpoint serving a recommendation model. Recently, downstream applications have reported intermittent failures. The engineer wants to be automatically notified whenever the endpoint returns a sustained elevated rate of server-side errors (HTTP 5xx) so the on-call team can respond quickly. Which approach requires the least custom instrumentation to meet this requirement?

Accepted Answer

Create a CloudWatch alarm on the built-in Invocation5XXErrors metric emitted by the endpoint in the AWS/SageMaker namespace, with an SNS action to notify the on-call team.

Answer

Enable SageMaker Model Monitor data quality monitoring and configure it to publish a violation whenever 5xx errors exceed a threshold.

Answer

Add custom logging in the inference container to write error counts to CloudWatch Logs, then build a metric filter and alarm on the parsed count.

Answer

Use AWS X-Ray tracing on the endpoint and configure an alarm on trace error rates to trigger an SNS notification.