Claude Certified Associate (Foundations)

Question 1

Your startup is preparing to launch a consumer-facing wellness app built on Claude that offers general lifestyle and stress-management tips. During a pre-launch review, the product manager suggests marketing it as a tool that can 'diagnose mental health conditions and recommend prescription treatments' to differentiate from competitors. As the responsible-deployment lead, what is the most appropriate action aligned with Anthropic's usage policies and a responsible-deployment mindset?

Accepted Answer

Reject positioning the app as providing medical diagnosis or prescription advice, and instead scope it to general wellness with clear disclaimers and escalation to licensed professionals for high-stakes health concerns.

Answer

Approve the feature since Claude produces fluent, confident responses that users will find helpful and authoritative.

Answer

Launch as proposed but add a temperature setting of 0 so the medical advice is deterministic and therefore safe to rely on.

Answer

Allow the diagnostic feature but require users to accept a terms-of-service checkbox waiving all liability, which removes the responsibility from the deployer.

Question 2

A team is building an agent that manages a customer's calendar. The agent can create, move, and delete events by calling tools. During testing, the agent frequently double-books slots because it decides which action to take next without ever incorporating the results of its previous tool calls. What is the most important design change to make this agent work reliably?

Accepted Answer

Feed each tool's result back into the model as an observation before it decides on the next action, so it can react to the current state of the calendar

Answer

Increase the max_tokens setting so the agent can produce longer plans up front and avoid needing to check results

Answer

Raise the temperature so the agent generates more varied scheduling options and is less likely to repeat conflicts

Answer

Replace the agent with a single prompt that lists all desired events and asks the model to output the full schedule at once

Question 3

A product team wants to build a feature that investigates customer complaints. Each complaint requires an unpredictable number of steps: reading the ticket, searching internal knowledge bases, querying order histories, and sometimes escalating to check shipping partner APIs — but the exact sequence and which tools are needed vary widely from case to case and cannot be known in advance. The team asks whether to implement this as a fixed workflow or as an agent. Which approach best fits this task, and why?

Accepted Answer

An agent, because the task requires the model to dynamically direct its own control flow and choose which tools to use based on what it discovers at each step.

Answer

A fixed workflow, because chaining a predetermined set of prompts is always more reliable than letting the model decide anything.

Answer

A fixed workflow using parallelization, because running all possible tool calls simultaneously guarantees every case is covered.

Answer

An agent, but only because agents are cheaper and faster than workflows for every task type.

Question 4

You are building an agent that manages calendar events. Early testing shows the agent frequently picks the wrong action because you exposed 14 narrowly-scoped tools (e.g., create_morning_event, create_afternoon_event, create_recurring_event, create_all_day_event, and similar variants). The model often confuses which tool applies. Following best practices for giving agents tools, what is the most effective change to improve reliability?

Accepted Answer

Consolidate the overlapping tools into a smaller set of general-purpose tools (e.g., one create_event tool with clear parameters) and write precise descriptions of when each applies.

Answer

Keep all 14 tools but force tool_choice to a specific tool on every request so the model cannot pick incorrectly.

Answer

Increase the temperature so the agent explores more tool options before committing to one.

Answer

Add even more granular tools to cover every possible edge case so there is always an exact match for the request.

Question 5

Your team is deploying an autonomous agent that manages cloud infrastructure by calling tools to provision, modify, and delete resources. During internal testing the agent occasionally deletes production databases when a user's request is ambiguous. The team wants the agent to remain capable of independent multi-step action but reduce the risk of catastrophic, irreversible operations. Which change best addresses this while preserving the agent's autonomy?

Accepted Answer

Add guardrails that require explicit human confirmation before executing high-impact, irreversible tool actions like deletions

Answer

Convert the entire system into a fixed prompt-chaining workflow so no step is model-directed

Answer

Lower the model temperature to 0 so the agent produces more deterministic tool calls

Answer

Increase the max_tokens limit so the agent can reason more thoroughly before acting

Question 6

A logistics company is building a system to reroute shipments during weather disruptions. Each disruption is different: the number of affected shipments, the alternate carriers available, and the sequence of checks needed vary widely and cannot be predicted in advance. The engineering team wants the system to figure out its own sequence of steps at runtime, calling tools to check carrier availability, inventory, and costs as needed until it produces a viable rerouting plan. Which implementation approach best fits these requirements?

Accepted Answer

An agent that is given the relevant tools and, guided by the model, decides which tools to call and in what order, looping until it reaches a viable plan

Answer

A fixed prompt-chaining workflow with a predefined sequence: check carriers, then check inventory, then compute costs, then output a plan

Answer

A routing workflow that classifies each disruption into one of three fixed categories and sends it to the matching specialized prompt

Answer

A parallelization workflow that runs the carrier, inventory, and cost checks simultaneously and merges the results into a plan

Question 7

You are building an agent that books meeting rooms by calling a scheduling tool. Currently, when a requested room is unavailable, the tool returns only 'false'. The agent frequently loops, re-requesting the same unavailable room, wasting tokens and time. Without changing the underlying booking logic, what is the most effective way to improve the agent's reliability?

Accepted Answer

Enrich the tool's return value to include why the booking failed and which alternative rooms and time slots are available, so the agent can reason toward a valid next action

Answer

Increase the temperature so the agent tries more varied room requests on each attempt

Answer

Remove the booking tool entirely and let the model answer from its own knowledge

Answer

Set tool_choice to force the booking tool on every turn to guarantee the agent keeps trying

Question 8

A team is building a coding assistant agent. They give it a file-search tool, a code-linter tool, and a git-commit tool. The lead asks the team to categorize each tool by whether it primarily lets the agent take actions that change the external environment or primarily gives the agent information to reason with. Which categorization is correct?

Accepted Answer

File-search and code-linter give the agent information; git-commit takes an action that changes the environment.

Answer

All three tools take actions that change the environment, since every tool call modifies state.

Answer

File-search takes an action; code-linter and git-commit only provide information.

Answer

All three tools only provide information, since the model still decides what to do afterward.

Question 9

Your team is building an internal assistant to handle IT support requests. Some requests are simple and always follow the same steps (e.g., 'reset my password' → verify identity → trigger reset → confirm). Others are open-ended troubleshooting problems where the resolution path is unknown up front and may require querying logs, checking system status, and deciding which tool to call next based on what earlier calls return. Which design best fits these two categories of requests?

Accepted Answer

Use a fixed workflow with predefined steps for the simple password-reset requests, and an agent with tool access and a feedback loop for the open-ended troubleshooting requests.

Answer

Use an agent for both categories so that a single implementation handles every request type consistently.

Answer

Use a fixed workflow for both categories, hard-coding every possible troubleshooting branch in advance.

Answer

Use an agent for the password resets to add flexibility, and a fixed workflow for the troubleshooting so the steps stay bounded.

Question 10

A team is building an automated system to resolve customer refund requests. Some requests are simple (one lookup, apply refund), while others require an unpredictable number of steps: checking order history, verifying return shipments, escalating to fraud checks, or requesting more information from the customer. The team cannot predetermine how many steps or which order they will occur for any given request. Which implementation approach best fits this situation?

Accepted Answer

An agent that dynamically decides which tools to call and when to stop, based on the evolving state of each request

Answer

A fixed prompt-chaining workflow with a predetermined sequence of the same steps for every request

Answer

A single large prompt that instructs the model to handle all possible refund cases in one response

Answer

A parallelization workflow that runs all possible checks simultaneously for every request

Question 11

A team builds a Claude-powered internal help desk that answers questions from a company knowledge base. During testing, they notice that when a user asks about a topic the knowledge base does not cover, Claude confidently invents a plausible-sounding but incorrect policy. The retrieval step is working correctly and only returns relevant passages. Which change to the prompt would most directly reduce these fabricated answers?

Accepted Answer

Explicitly instruct Claude that if the provided knowledge base passages do not contain the answer, it should say it does not know rather than guess.

Answer

Increase the temperature so Claude produces more varied responses across attempts.

Answer

Raise the max_tokens limit so Claude has more room to fully explain each policy.

Answer

Add a role prompt telling Claude it is a highly experienced, authoritative policy expert.

Question 12

A developer is building a feature that asks Claude to classify support tickets and return only a single category word (e.g., 'Billing'). They notice Claude sometimes prepends conversational text like 'Sure, the category is...' before the answer. Using only the Messages API structure, what is an effective technique to make Claude begin its response with the category directly?

Accepted Answer

Add a final message with the role 'assistant' containing a partial response to prefill the start of Claude's answer

Answer

Set temperature to 0 so Claude cannot add any introductory phrasing

Answer

Add a second 'system' message immediately before the assistant turn

Answer

Increase max_tokens so Claude has room to finish the classification cleanly

Question 13

You are building a customer support chatbot using the Messages API. To preserve context across turns, you send the full conversation history with each new request. In this history, what content should be placed in messages that use the 'assistant' role?

Accepted Answer

Claude's previous replies from earlier turns in the conversation

Answer

The overall behavioral instructions and persona for the bot

Answer

The customer's incoming questions and requests

Answer

Metadata such as timestamps and the user's account ID

Question 14

A support team deploys an agent that can call several tools (knowledge base search, ticket lookup, refund API) to resolve customer issues autonomously. During testing, a few conversations spiral: the agent repeatedly calls tools, racks up high token costs, and occasionally never returns a final answer. The team wants to keep the agent capable but reliable and bounded. Which change most directly addresses this problem?

Accepted Answer

Set a maximum number of tool-use iterations per conversation and stop with a fallback response once the limit is reached

Answer

Raise the temperature so the agent explores more solution paths and finishes faster

Answer

Replace the agent with parallel tool calls that fire all tools simultaneously on every turn

Answer

Remove the tool descriptions so the model spends fewer tokens deciding which tool to use

Question 15

A financial analyst at your firm is using Claude to evaluate whether loan applications meet a set of complex, interdependent eligibility rules. The model frequently returns a correct-sounding final verdict but occasionally reaches the wrong conclusion, and the analyst cannot tell where the reasoning went astray. Which prompt engineering technique should the analyst apply first to improve accuracy on this multi-step reasoning task?

Accepted Answer

Ask Claude to work through the eligibility rules step by step before stating its final verdict (chain of thought)

Answer

Lower the max_tokens value so Claude produces a shorter, more focused answer

Answer

Prefill the assistant response with the word 'Approved' to guide the output

Answer

Increase the temperature so Claude explores more possible interpretations of the rules

Question 16

A financial analyst wants Claude to evaluate whether loan applications meet a set of five specific eligibility rules. Early tests show Claude sometimes skips rules or gives a verdict without checking each one. The analyst wants to improve reasoning quality but keeps getting inconsistent results when simply saying 'think about it carefully.' Which chain-of-thought refinement is most likely to improve accuracy?

Accepted Answer

Replace the vague instruction with guided steps that tell Claude to evaluate each of the five rules one at a time before stating a final verdict

Answer

Lower the temperature to 0 so Claude produces the same output every time regardless of reasoning depth

Answer

Add 'be accurate and thorough' to the end of the prompt to emphasize the importance of the task

Answer

Increase max_tokens so Claude has more room to write, which will automatically make it reason through every rule

Question 17

A financial analyst uses Claude to evaluate loan applications. She wants Claude to reason step-by-step through each application's risk factors before giving a final approval decision, but her downstream system only needs the final decision (APPROVE or DENY) so it can be parsed automatically. What is the best prompting approach to satisfy both needs?

Accepted Answer

Instruct Claude to put its reasoning inside tags and its final decision inside tags, so the reasoning happens before the answer while the parseable output stays isolated.

Answer

Instruct Claude to output only APPROVE or DENY with no reasoning, to keep the response easy to parse.

Answer

Lower the temperature to 0 so Claude reasons internally and returns only the final decision.

Answer

Ask Claude to give the decision first, then explain its reasoning afterward for transparency.

Question 18

Your team is building a legal document analysis feature that must reason through complex, multi-clause contracts and produce nuanced summaries. Accuracy on subtle legal reasoning is the top priority, and the feature runs asynchronously in the background, so response time is not a concern. Occasional per-request cost is acceptable given the low volume. Which model-selection approach best fits these requirements?

Accepted Answer

Choose the most capable model in the Claude family, since deep reasoning accuracy is the priority and latency and volume are not constraints

Answer

Choose the fastest, lowest-cost model in the family to minimize per-request spend

Answer

Choose a mid-tier model and lower temperature to 0 to force correct legal reasoning

Answer

Choose any model but expand max_tokens dramatically, since larger output limits improve reasoning quality

Question 19

Your team runs a customer-support chat tool that classifies incoming messages into one of five intent categories. The task is simple and well-defined, but you process millions of messages per day and need responses in well under a second while keeping costs low. Accuracy on this narrow task is already excellent with smaller models. Which model-selection approach best fits these requirements?

Accepted Answer

Choose the fastest, most cost-efficient model in the Claude family, since the task is simple and prioritizes low latency and high volume.

Answer

Choose the most capable (largest) model in the Claude family to guarantee the highest possible classification accuracy.

Answer

Choose a model based solely on its maximum context window size, since larger context windows always reduce latency.

Answer

Alternate randomly between the largest and smallest models to balance cost and accuracy across requests.

Question 20

A support engineer is writing a prompt for Claude to draft customer email replies. Their current prompt says: "Do not be too formal. Do not use jargon. Do not write more than three paragraphs." The replies are inconsistent — sometimes overly stiff, sometimes cluttered with technical terms. The engineer wants to make the instructions clearer and more reliable without adding examples yet. Applying the 'be clear and direct' technique, what is the single best change to the prompt?

Accepted Answer

Rewrite the instructions to state affirmatively what to do, e.g., "Write in a warm, conversational tone, use plain everyday language, and keep the reply to three paragraphs or fewer."

Answer

Lower the temperature to 0 so the model follows the negative instructions more deterministically.

Answer

Add a system prompt assigning Claude the role of a senior customer support agent and leave the negative instructions unchanged.

Answer

Wrap each 'Do not' instruction in its own XML tag so the model parses the constraints separately.

Question 21

A support engineer is building a prompt that asks Claude to process a customer refund request. The task involves verifying the order ID, checking the return window, calculating the refund amount, and drafting a customer email. In testing, Claude frequently drafts the email before performing the verification and calculation, and sometimes skips the return-window check entirely. The engineer wants to keep this as a single prompt. What is the most effective way to fix this behavior?

Accepted Answer

Rewrite the instructions as explicit numbered sequential steps, telling Claude to complete each step in order before moving to the next

Answer

Increase the temperature so Claude explores more of the task requirements

Answer

Add a stop sequence after the email draft so Claude cannot skip steps

Answer

Lower max_tokens to force Claude to be more concise and focused

Question 22

A product team asks Claude to "write documentation for our new API." The output is generic and pitched at a level that confuses their audience of non-technical business analysts. The team wants Claude to consistently produce docs the analysts can follow, without switching models or adding examples. Which single adjustment to the prompt best applies the clear-and-direct technique?

Accepted Answer

Explicitly state the intended audience, their technical level, and how the output will be used (e.g., 'Write for non-technical business analysts who will use this to decide whether to adopt the API')

Answer

Lower the temperature to 0 so the documentation is more deterministic and consistent

Answer

Add a stop sequence so Claude halts before generating overly technical sections

Answer

Increase max_tokens so Claude has room to fully explain each concept

Question 23

A support team asks Claude to "make this customer email better" and pastes a draft reply. The results are inconsistent — sometimes Claude shortens the email, sometimes it adds legal disclaimers, and sometimes it changes the tone entirely. The team wants more predictable output without adding examples or changing models. Applying the 'be clear and direct' technique, what is the best first change to the prompt?

Accepted Answer

Explicitly specify the desired outcome: e.g., 'Rewrite this email to be more concise and empathetic, keeping it under 150 words and without adding new policy claims.'

Answer

Raise the temperature so Claude explores more rewriting styles and picks the best one.

Answer

Add a stop sequence after the first sentence so Claude cannot over-edit the email.

Answer

Switch to a smaller, faster model to reduce variability in the responses.

Question 24

A support team has finalized a prompt for summarizing customer tickets. They want to reuse the exact same prompt structure across hundreds of tickets, changing only the ticket text each time, and manage it centrally in the Anthropic Console. Which Console feature best supports this need?

Accepted Answer

Use templates with variables, placing a {{TICKET_TEXT}} placeholder where the ticket content is inserted for each run

Answer

Use the prompt generator to draft a brand-new prompt for every incoming ticket

Answer

Use the prompt improver to automatically rewrite the prompt each time a ticket arrives

Answer

Raise the temperature setting so the model adapts its output to each different ticket

Question 25

A developer at a legal-tech company needs to analyze a single 280,000-token contract in one API call to answer questions about clauses scattered throughout the document. Their current integration truncates the document because it exceeds the model's input limit, causing incomplete answers. Which approach best addresses the root cause while keeping the analysis in a single request?

Accepted Answer

Select a Claude model whose context window is large enough to fit the full document plus the prompt and expected output tokens.

Answer

Increase the max_tokens parameter so the model can read more of the input document.

Answer

Lower the temperature to 0 so the model processes the entire document more efficiently.

Answer

Enable streaming so the full document can be sent incrementally past the input limit.

Question 26

A team is about to start improving the prompt for a customer-support classification feature. Before they iterate on wording, examples, and XML structure, a senior engineer insists they complete one foundational step first. According to Anthropic's prompt engineering guidance, what should the team do before beginning prompt engineering?

Accepted Answer

Define clear, measurable success criteria and build an evaluation set to test prompts against empirically

Answer

Switch to the largest available model to establish maximum possible accuracy

Answer

Prefill the assistant response so outputs are already partially formatted before testing

Answer

Increase max_tokens to ensure no responses are truncated during testing

Question 27

Your team has built a test set of 500 prompts to evaluate a customer-support summarization feature before each release. Manually reading and scoring every model output takes two engineers a full day, which is delaying releases. The outputs are free-form summaries where correctness is somewhat subjective. Which approach best lets the team scale their evaluation while keeping quality judgments trustworthy?

Accepted Answer

Use an LLM-based grader with a clear rubric to score all 500 outputs automatically, and have humans spot-check a sample to validate the grader's alignment with human judgment.

Answer

Reduce the test set to 20 prompts so the two engineers can finish grading in under an hour each release.

Answer

Skip the evaluation for minor releases and rely on user complaints to surface any quality regressions after deployment.

Answer

Switch entirely to exact-string matching against a single approved summary for each prompt to make grading fully automatic.

Question 28

Your team maintains a customer-facing summarization assistant with an automated eval suite of 200 test cases that all pass with high scores. After deployment, users report the assistant occasionally invents product features that don't exist when summarizing sparse or off-topic support tickets. Your current test set contains only well-formed, feature-rich tickets. What is the most effective next step to improve your evaluation process?

Accepted Answer

Add representative test cases covering sparse, ambiguous, and off-topic tickets—including expected 'no relevant features found' outputs—so the eval catches the failure mode

Answer

Raise the passing score threshold on the existing 200 test cases so the eval is stricter overall

Answer

Switch from automated grading to manually reviewing every production output before it reaches users

Answer

Increase the model's temperature so summaries have more variety and feel less repetitive

Question 29

A team maintains a customer-support summarization prompt that scores 92% on their curated evaluation set of 200 labeled examples. A developer proposes a prompt change that they believe reads more clearly and 'feels better' in a few manual spot-checks. Before deploying the change to production, what is the most responsible next step consistent with an evals-driven workflow?

Accepted Answer

Re-run the full evaluation set against the new prompt and compare scores to the 92% baseline before deciding to deploy

Answer

Deploy the new prompt immediately since it reads more clearly and the developer's spot-checks looked good

Answer

Add the new prompt's spot-check outputs to the evaluation set as additional ground-truth examples

Answer

Increase the temperature on the new prompt so its outputs vary more and cover more cases during spot-checks

Question 30

A team is building a customer-facing assistant that drafts support replies. Leadership says the replies must be 'good.' Before writing any evals, the team wants to translate this into something they can actually measure. Which approach best defines useful success criteria for their evaluation?

Accepted Answer

Specify concrete, measurable targets across the dimensions that matter—such as factual accuracy against the knowledge base ≥95%, correct tone on a rubric, and no policy violations—each with a threshold.

Answer

Ask several team members to read a handful of outputs and give a thumbs-up or thumbs-down based on overall impression.

Answer

Set a single target of 'user satisfaction should improve' and check it after the assistant has been live for a quarter.

Answer

Adopt whatever benchmark scores the model reports on public leaderboards as the definition of quality for this use case.

Question 31

A team maintains a customer-support summarization prompt in production. Before shipping any prompt change, they want a reliable way to confirm the new version does not degrade quality compared to the current version. They have 200 representative support transcripts. Which approach best supports catching quality regressions when they update the prompt?

Accepted Answer

Establish scored baseline results for the current prompt on all 200 transcripts using a fixed grading rubric, then re-run and compare the new prompt's scores against that baseline before shipping

Answer

Run the new prompt on the 200 transcripts, spot-check a handful of outputs by reading them, and ship if those few look reasonable

Answer

Increase the temperature on the new prompt so it produces more varied summaries, making regressions easier to notice by eye

Answer

Ask the model to grade its own new summaries and approve the change if the model reports high confidence

Question 32

Your team built an evaluation set of 200 examples to measure the quality of a document-summarization prompt. Each summary can be correct in many valid phrasings, so exact string matching against a reference summary produces misleadingly low scores. You need a grading method that scores summaries reliably at this scale without a human reviewing all 200 outputs each run. Which grading approach best fits this evaluation?

Accepted Answer

Use an LLM-based grader ('model-graded eval') with a clear rubric that checks whether each summary captures the required key points and stays faithful to the source

Answer

Keep exact-match scoring but lower the pass threshold so more summaries count as correct

Answer

Drop the evaluation set and rely on the team informally reading a few outputs to judge whether the prompt 'feels' good

Answer

Have one engineer manually grade all 200 summaries by hand on every prompt iteration

Question 33

A team iterating on a customer-support classification prompt has been tuning it repeatedly against the same 50-example test set. Their scores keep improving, but when they deploy, real-world accuracy is noticeably lower than their eval suggested. What is the most likely cause and best corrective action?

Accepted Answer

The prompt has been overfit to the small test set; they should maintain a separate held-out set that they do not tune against and use it to validate generalization.

Answer

The model temperature is too high; they should set it to 0 and the eval scores will match production.

Answer

The test set is too large to be reliable; they should shrink it to 10 examples for faster iteration.

Answer

Automated grading is inherently inaccurate; they should abandon the eval and rely on manual spot-checks instead.

Question 34

A team has been improving a customer-support summarization prompt by reading a few outputs each day and tweaking wording whenever a summary 'feels off.' Recent changes seem to help some cases but silently break others, and no one can tell whether overall quality is trending up or down. Which change to their process best addresses this problem?

Accepted Answer

Establish a representative evaluation set with defined success criteria and graded metrics, then measure each prompt change against it before shipping.

Answer

Increase the model's temperature so summaries have more variety, making quality differences easier to notice by eye.

Answer

Have each team member review more sample outputs per day so subjective impressions are based on a larger informal sample.

Answer

Switch to a larger, more capable model so that manual spot-checking becomes unnecessary.

Question 35

Your team runs automated evaluations on Claude's customer-email drafts using another Claude call as an LLM-based grader. Reviewers notice the grader assigns wildly different scores to nearly identical drafts across runs, making it hard to trust regression results. What change would most improve the reliability of these automated grades?

Accepted Answer

Give the grader a detailed scoring rubric with explicit criteria and examples, and set a low temperature for the grading call

Answer

Increase the temperature of the grading call so the grader considers more diverse interpretations of quality

Answer

Reduce the test set to only the three drafts reviewers agree are perfect examples

Answer

Replace the LLM grader with a single human reviewer who scores drafts whenever they have time

Question 36

Your team built an eval suite for a customer-support assistant that generates free-form answers to billing questions. You chose exact-string match against golden answers as your grading metric. In practice, the assistant produces correct, well-phrased responses that differ in wording from your golden answers, so your eval reports a very low pass rate even though humans judge the outputs as good. What is the best fix?

Accepted Answer

Switch the grading approach to a semantic or LLM-based rubric grader that scores whether the response conveys the correct information, rather than requiring identical wording

Answer

Delete the golden answers and rely on periodic manual spot-checks by the team instead of an automated eval

Answer

Lower the temperature to 0 so the model always produces the exact wording in your golden answers

Answer

Reduce max_tokens so responses are shorter and more likely to match the golden answers exactly

Question 37

Your team has a customer-support summarization prompt in production, backed by a stable test set of 200 representative cases with defined success metrics. Anthropic releases a newer model version, and a teammate proposes switching to it because it 'feels smarter' after trying a few chat examples. Before committing to the new model, what is the most responsible evaluation practice?

Accepted Answer

Run the existing 200-case eval set against the new model and compare metric scores to the current baseline before deciding

Answer

Deploy the new model immediately to all users since newer versions are always improvements

Answer

Build a brand-new test set specifically flattering to the new model's strengths, then measure it

Answer

Have the teammate try 10 more chat examples and switch if the outputs subjectively look better

Question 38

A data analyst is building a workflow where Claude must (1) extract key financial figures from lengthy quarterly reports, (2) analyze those figures for year-over-year trends, and (3) produce an executive summary. When the analyst tries to do all three in a single prompt, Claude frequently drops figures, mixes up the analysis, and produces inconsistent summaries. Which prompt engineering technique should the analyst apply to improve reliability?

Accepted Answer

Prompt chaining: break the task into separate sequential prompts, passing each step's output as input to the next

Answer

Prefill the assistant response with the final executive summary format to force consistency

Answer

Add more few-shot examples of complete reports inside the single prompt to cover every case

Answer

Switch to a smaller, faster model to reduce the chance of errors on the long input

Question 39

A legal-tech team is using Claude to review commercial contracts and flag risky clauses. The output is technically correct but reads like generic advice, missing the precise, cautious tone and terminology a corporate attorney would use. The team wants to shift Claude's responses toward that of an experienced contracts lawyer without adding lengthy new instructions. Which prompt engineering technique most directly addresses this need?

Accepted Answer

Assign Claude a role in the system prompt, such as 'You are a senior corporate contracts attorney reviewing agreements for enterprise clients.'

Answer

Increase the temperature so Claude produces more varied, expressive language in its clause analysis.

Answer

Raise the max_tokens value so Claude has room to produce more detailed legal explanations.

Answer

Add a stop sequence so Claude ends its response after listing the risky clauses.

Question 40

A data analyst is building a prompt that asks Claude to solve multi-variable word problems and return only the final numeric answer. In testing, Claude frequently returns wrong numbers even though the problems are solvable. The analyst wants to improve accuracy without switching models or adding examples. Which single change is most likely to help?

Accepted Answer

Instruct Claude to work through its reasoning step by step before stating the final answer

Answer

Lower the temperature to 0 so the output is fully deterministic

Answer

Add a stop sequence after the numeric answer to prevent extra text

Answer

Reduce max_tokens so Claude commits to an answer more quickly

Question 41

A financial analyst is building a prompt that asks Claude to evaluate whether a loan application should be approved based on several criteria. The analyst wants Claude to reason through each criterion before committing to a final decision, so they add 'Think step by step' to the prompt. However, in testing, Claude often states its approval decision in the first sentence and then writes reasoning that merely justifies that snap decision. What is the most effective adjustment to genuinely improve the quality of Claude's reasoning?

Accepted Answer

Explicitly instruct Claude to write out its analysis inside tags first, and to place its final decision only afterward inside tags.

Answer

Increase the temperature setting so Claude explores more reasoning paths before deciding.

Answer

Add the phrase 'Think step by step' a second time at the end of the prompt for emphasis.

Answer

Prefill the assistant response with the word 'Approved:' to guide the output format.

Question 42

A developer is building a chatbot that generates short product descriptions. They want to ensure Claude never produces a reply longer than roughly 150 words, both to control cost and keep the UI clean. Which Messages API parameter should they configure for this purpose?

Accepted Answer

Set an appropriate max_tokens value to cap the length of the generated response.

Answer

Set temperature to a low value so the model produces shorter outputs.

Answer

Add the word count to the system prompt and rely on it exclusively to enforce the hard limit.

Answer

Reduce the context window size so the model has less room to generate text.

Question 43

You are building a feature that asks Claude to return a detailed JSON object summarizing a customer support ticket. During testing, you notice the model's responses are consistently cut off mid-object, producing invalid JSON that your parser rejects. Your prompt and temperature settings appear correct. Which change is most likely to resolve the truncation?

Accepted Answer

Increase the max_tokens value so the response has enough room to complete the full JSON object

Answer

Lower the temperature to 0 so the model produces more deterministic output

Answer

Add a stop sequence of '}' so generation halts cleanly at the end of the object

Answer

Switch to a model with a larger context window to fit the longer response

Question 44

Your engineering team wants to connect Claude to your company's internal PostgreSQL database and a Google Drive folder using the Model Context Protocol (MCP). A developer asks you to clarify the architecture: which component actually exposes the database and Drive as accessible resources, and which component the Claude-powered application uses to consume them?

Accepted Answer

An MCP server exposes each data source (the database and Drive), and the Claude application acts as an MCP client that connects to those servers to access the resources.

Answer

An MCP client wraps each data source, and the Claude application runs an MCP server to pull data from those clients.

Answer

Both the data sources and the Claude application must run MCP servers, which communicate directly with each other without any client.

Answer

The Claude model itself becomes the MCP server, and the data sources connect to it as clients over the API.

Question 45

Your engineering team currently maintains separate, custom integration code for each tool and data source they want Claude to access (a Postgres database, a GitHub repo, and an internal ticketing system). A colleague suggests adopting the Model Context Protocol (MCP) to reduce this maintenance burden. At a conceptual level, what does MCP primarily provide in this situation?

Accepted Answer

An open, standardized protocol so that Claude can connect to external tools and data sources through a common interface instead of bespoke one-off integrations

Answer

A managed cloud service that automatically fine-tunes Claude on your database and ticketing data

Answer

A prompt-templating framework that stores reusable prompt variables for each data source

Answer

A caching layer that stores repeated tool results to reduce token costs across requests

Question 46

A development team wants Claude to read from their company's internal Postgres database and query their ticketing system. They plan to build reusable connectors so that multiple AI applications inside the company can access these same data sources without each app re-implementing the integration. Which approach aligns with the purpose of the Model Context Protocol (MCP)?

Accepted Answer

Build MCP servers that expose the database and ticketing system, so any MCP-compatible client can connect to them through a standard protocol

Answer

Embed the full database contents into every prompt's system message so Claude always has the data available

Answer

Increase the max_tokens parameter so Claude can generate the database records from memory

Answer

Use higher temperature so Claude creatively infers the ticketing data without a connection

Question 47

Your company has built five separate custom integrations connecting Claude to an internal wiki, a ticketing system, a database, a calendar, and a file store. Each integration uses its own bespoke connection code, and every time you add a new AI application, developers must rewrite these connectors from scratch. A colleague suggests adopting the Model Context Protocol (MCP). What is the primary benefit MCP provides in this situation?

Accepted Answer

It provides a standardised, open protocol so tools and data sources are exposed once via MCP servers and reused across any MCP-compatible client, avoiding rewriting bespoke connectors.

Answer

It automatically improves Claude's reasoning quality by injecting chain-of-thought prompts before each tool call.

Answer

It replaces the need to define tool input schemas because MCP infers all parameters from natural language descriptions.

Answer

It reduces token costs by compressing tool results before they are returned to the model.

Question 48

A developer is writing their first integration with the Messages API. They construct a request with the model name, a system prompt, and a single user message, then send it. The API returns an error before any generation occurs. Which commonly-omitted required parameter is the most likely cause of the error?

Accepted Answer

max_tokens

Answer

temperature

Answer

stop_sequences

Answer

stream

Question 49

A developer is building a customer support chatbot with the Messages API. They want to send a conversation that includes the user's first question, Claude's first answer, and the user's follow-up question in a single API request so Claude can respond with full context. How should the `messages` array be structured?

Accepted Answer

An array alternating roles: a user message, then an assistant message, then another user message

Answer

A single user message containing the entire conversation transcript as one concatenated string

Answer

Two user messages placed first, followed by one assistant message at the end

Answer

A system message for the user's question, an assistant message for the answer, and a system message for the follow-up

Question 50

A developer is building a billing dashboard for an internal tool that uses the Messages API (non-streaming). After each request completes, they need to record exactly how many input and output tokens were consumed by that specific call, without having to re-estimate the text themselves. Where should they look to get this accurate per-request count?

Accepted Answer

The `usage` object in the API response, which reports `input_tokens` and `output_tokens` for the call

Answer

The `max_tokens` value they set in the request, since it equals the tokens actually generated

Answer

The `stop_reason` field, which contains the total token count for the response

Answer

A separate call to a word-count endpoint after every request to approximate token totals

Question 51

You are building a customer support chatbot with the Messages API. A user has asked three questions across a session, and Claude has answered each one. The user now types a follow-up that says 'What about the second option you mentioned?' To ensure Claude can correctly reference its earlier reply, how should you structure the request?

Accepted Answer

Include the full alternating sequence of prior user and assistant messages in the messages array, followed by the new user message.

Answer

Send only the latest user message and rely on Claude to remember the prior turns automatically.

Answer

Concatenate all prior turns into a single system prompt and send only the new user message in the messages array.

Answer

Send only the assistant's previous responses in the messages array so Claude can see what it said before.

Question 52

A support team uses Claude to categorize incoming tickets into one of five priority levels. Their prompt includes three examples, all showing clear-cut 'high' and 'low' priority tickets. In testing, Claude handles obvious tickets well but frequently mislabels ambiguous, borderline tickets that fall into the middle priority levels. The team wants to improve accuracy on these harder cases without switching models. What is the most effective adjustment to their multishot examples?

Accepted Answer

Add examples that specifically cover the ambiguous, borderline, and edge-case tickets, including the middle priority levels

Answer

Remove the existing examples so Claude relies on its own judgment for all tickets

Answer

Duplicate the three existing high/low examples several more times to reinforce the pattern

Answer

Increase the temperature so Claude explores more varied priority assignments

Question 53

A support team wants Claude to generate replies to customer emails in a very specific style: a warm greeting, a two-sentence apology, and a bulleted list of next steps. Their current prompt describes this style in prose, but Claude's outputs vary widely in structure and tone from one email to the next. The team does not want to change models and has confirmed the task is well-suited to Claude. What is the most effective prompt engineering technique to make the output format and tone consistent?

Accepted Answer

Include several example email-and-reply pairs in the prompt that demonstrate the exact greeting, apology, and bulleted next-steps format.

Answer

Raise the temperature so Claude produces more varied and creative replies.

Answer

Add a stop sequence after the greeting so Claude halts before drifting off format.

Answer

Reduce max_tokens so the replies are forced to stay short and uniform.

Question 54

A support team uses Claude to classify incoming tickets into categories like 'Billing', 'Technical', and 'Account'. With a simple instruction-only prompt, Claude often invents new category names or formats its answers inconsistently. The team wants to improve accuracy and enforce a consistent output style without switching models. What prompt engineering technique should they apply first?

Accepted Answer

Add several example ticket-to-category pairs directly in the prompt (multishot prompting) that demonstrate the exact categories and output format

Answer

Raise the temperature so Claude explores a wider range of category possibilities

Answer

Remove all instructions and rely solely on a system prompt persona describing a support agent

Answer

Split the task into a chain of five separate prompts, one per category, and merge the results

Question 55

You are building a travel assistant with Claude. For a single user request, Claude needs to look up the weather for three different cities before making a recommendation. The three weather lookups are completely independent of one another and use the same tool with different inputs. How should you handle this to minimize total latency?

Accepted Answer

Allow Claude to request all three weather lookups as parallel tool calls in one response, then return all three tool results together in the next user message.

Answer

Force Claude to make the three lookups sequentially, returning each result before it can request the next city.

Answer

Disable tool use and ask Claude to estimate the weather for all three cities from its training data.

Answer

Combine the three cities into a single tool description so Claude only needs to call the tool once with no arguments.

Question 56

A support team sends requests to Claude that all begin with the same 8,000-token knowledge base document, followed by a short, unique customer question that changes with every request. They enable prompt caching to reduce cost and latency. To get the maximum benefit from caching, where should the reusable content be positioned relative to the variable content in each request?

Accepted Answer

The stable knowledge base should come first, with the cache breakpoint placed after it, and the unique customer question placed after the cached portion.

Answer

The unique customer question should come first so it is cached, followed by the knowledge base document.

Answer

The knowledge base and the customer question should be interleaved so each cache entry stays small.

Answer

Caching only works when the entire request, including the customer question, is identical across calls, so ordering does not matter.

Question 57

You are building a customer-support assistant that answers questions about a 40-page product manual. Every request sends the same large manual as context in the system prompt, followed by a different short user question. Latency and cost are climbing as traffic grows. Which Messages API feature best addresses this while keeping the manual available on every turn?

Accepted Answer

Enable prompt caching on the large, unchanging manual portion so it is reused across requests

Answer

Lower the temperature parameter to reduce the number of tokens processed

Answer

Set a stop sequence after the manual so the model ignores it during generation

Answer

Reduce max_tokens so the model reads less of the input context

Question 58

You are building a customer-support assistant that has access to a `lookup_order` tool. Many incoming messages are simple greetings or general questions ('What are your hours?') that do not need any tool, while others clearly require an order lookup. You want Claude to answer directly when no tool is needed but call the tool when it is appropriate. Which `tool_choice` setting best fits this requirement?

Accepted Answer

Set `tool_choice` to `{"type": "auto"}` so Claude decides per message whether to use a tool or answer directly.

Answer

Set `tool_choice` to `{"type": "any"}` so Claude always uses one of the available tools.

Answer

Set `tool_choice` to `{"type": "tool", "name": "lookup_order"}` to guarantee consistent behavior.

Answer

Set `tool_choice` to `{"type": "none"}` so Claude never calls tools and stays fast.

Question 59

You have configured a customer-support assistant with three tools (order lookup, refund processor, and shipping tracker). A user asks a general question: 'What are your store's holiday return policies?' You want Claude to answer directly from its system-prompt knowledge without invoking any tool for this particular request. Which approach correctly prevents tool use for this call?

Accepted Answer

Set the tool_choice parameter to {"type": "none"} for this request so Claude answers without calling any tool.

Answer

Remove all tool definitions from the request permanently so they can never be used again in the conversation.

Answer

Set tool_choice to {"type": "any"} so Claude is required to select the most relevant tool.

Answer

Add a stop sequence matching the tool names so generation halts before a tool is called.

Question 60

You are building a customer-support assistant that must always log a ticket by calling the `create_ticket` tool at the end of every conversation, regardless of the user's phrasing. During testing, Claude sometimes replies with a plain text summary instead of invoking the tool. Which configuration best guarantees that Claude calls `create_ticket` on the relevant request?

Accepted Answer

Set the `tool_choice` parameter to force use of the specific `create_ticket` tool.

Answer

Set `tool_choice` to `auto` and add more examples to the system prompt.

Answer

Set `tool_choice` to `none` so Claude focuses only on the ticket.

Answer

Lower the temperature to 0 so Claude behaves deterministically.

Question 61

A developer is adding a currency-conversion capability to a Claude-powered assistant. They want Claude to be able to invoke this capability during the conversation. When defining the tool in the API request, which three components must the developer provide for the tool definition to be valid and usable by Claude?

Accepted Answer

A name, a description, and an input JSON schema describing the parameters

Answer

A name, the URL of the external service, and an authentication token

Answer

A description, an example output, and a maximum token limit for the result

Answer

A unique ID, a temperature value, and a stop sequence for the tool

Question 62

You've defined a tool called get_weather for a travel assistant. Claude frequently calls it with vague or incorrect location values (e.g., 'there' or a hotel name instead of a city). The input schema already requires a 'location' string. What is the most effective first change to reduce these errors?

Accepted Answer

Improve the tool's description and the 'location' field description to specify the expected format, e.g., a city and country name like 'Paris, France'.

Answer

Set tool_choice to force Claude to always call get_weather on every turn.

Answer

Remove the input schema so Claude can pass whatever value it wants without validation.

Answer

Lower the temperature to 0 so Claude becomes more deterministic when selecting arguments.

Question 63

You are building a scheduling assistant with a tool called book_meeting. During testing, Claude frequently calls the tool with the date in an inconsistent format (sometimes 'next Tuesday', sometimes '2024-06-11'), causing the backend to reject requests. The tool's input schema already specifies a 'date' field as a string. What is the most effective change to reduce these malformed calls?

Accepted Answer

In the tool description, clearly specify the expected date format (e.g., ISO 8601 'YYYY-MM-DD') and note that relative dates must be resolved first.

Answer

Add stop sequences to the request so Claude halts before producing an incorrect date format.

Answer

Set tool_choice to force the book_meeting tool on every turn so Claude always uses it.

Answer

Lower the temperature to 0 so Claude produces the same date format each time.

Question 64

You are defining a `get_account_balance` tool for a banking assistant. During testing, Claude frequently calls the tool even when users ask general questions like "What are your business hours?" that have nothing to do with balances. The tool's name and input schema are correct. What is the most effective change to reduce these inappropriate calls?

Accepted Answer

Rewrite the tool description to clearly state what the tool does and specify when it should and should not be used.

Answer

Set tool_choice to "any" so Claude is forced to always select some tool.

Answer

Remove the input schema so Claude cannot invoke the tool as easily.

Answer

Lower the max_tokens value to prevent the model from producing tool-use blocks.

Claude Certified Associate (Foundations) (CCAO-F) full-length practice exam

How this timed CCAO-F mock exam works

What your CCAO-F results show

How to get the most out of it

Ready for the full CCAO-F mock exam?