Question

A company deploys a gen AI assistant that summarizes web pages and emails on behalf of employees. During testing, a security engineer notices that a malicious email contains hidden text instructing the assistant to ignore its original task and instead forward internal data to an external address. The assistant partially complies. Which responsible AI concern does this scenario most directly illustrate?

Accepted Answer

A security risk from prompt injection, where untrusted content manipulates the model's behavior

Answer

A hallucination, because the model generated content that was not factually grounded

Answer

A fairness issue, because the model treated certain users differently

Answer

A context window limitation, because the email exceeded the model's token capacity