Question

A financial services company has a Copilot Studio agent that answers customer questions about loan products. The agent is grounded on SharePoint policy documents and uses two custom actions. Business analysts frequently update topics and knowledge sources, and each change has occasionally broken previously working answers before reaching production. The architect must design a testing approach within the ALM pipeline that catches these regressions automatically before deployment to the production environment. Which approach should the architect adopt?

Accepted Answer

Maintain a versioned set of test cases with expected responses and run them automatically against the agent in a test environment as part of the deployment pipeline, gating promotion on pass rate.

Answer

Rely on the Copilot Studio conversation transcripts in the production environment and have analysts review them after each release.

Answer

Enable content moderation at the highest sensitivity level so that unexpected answers are blocked at runtime.

Answer

Export the solution to a managed solution and let the target environment's import validation confirm the agent behaves correctly.