Question

Your team deployed a generative AI assistant on Vertex AI that answers customer questions by drawing on an internal knowledge base. During a responsible-AI review, security raises a concern: the model occasionally echoes back personally identifiable information (PII) such as email addresses and account numbers that appeared in the prompt or retrieved context. Leadership wants an ongoing safeguard that reduces the risk of PII being surfaced in production responses without retraining the model. Which approach best mitigates this privacy risk?

Accepted Answer

Add a post-processing inspection step that runs each model response through Cloud Data Loss Prevention (DLP) to detect and redact PII before returning it to the user, and log detections for auditing.

Answer

Enable Vertex AI Model Monitoring for feature attribution drift so you can detect when input distributions change over time.

Answer

Increase the model's temperature setting so that responses are more varied and less likely to reproduce exact strings from the context.

Answer

Retrain the model with differential privacy so memorized training examples cannot be reconstructed.