BrainyBeeBrainyBee
Hands-on Lab1,771 words

Output Evaluation and Validation — practice exercise

Output Evaluation and Validation — practice exercise

Difficulty: intermediate · Estimated duration: 50–65 minutes

You will do this exercise in the Claude app, with a spreadsheet or a calculator for one step. No code is involved. Stages 1–4 work on web, desktop or mobile; Stage 5 needs Claude on the web or desktop, with the code execution and file creation capability turned on (organization owners can disable it). Every document you need is provided below and invented for practice, so you can check Claude’s answers against them rather than against facts you would have to look up. Keep a short record as you go.

Practice document — remote working policy (extract), used in Stages 2, 3 and 5:

Staff may work remotely up to three days a week with their manager’s approval. Requests are made in the HR portal at least two weeks in advance. Equipment for home working is provided on request; staff are responsible for keeping their home workspace safe.

StageWhat you practiseMinutes
1Spotting what needs checking, and whether an answer is complete17
2Exposing inconsistency8
3Fact-checking against a source and grounding answers12
4Deciding who must review8
5Shaping output for its reader and format12

Stage 1 — Spot what needs checking

Skills: CCAOF-U2.T1.LO1.S1, CCAOF-U2.T1.LO1.S2, CCAOF-U2.T1.LO1.S3, CCAOF-U2.T1.LO1.S4, CCAOF-U2.T1.LO2.S1, CCAOF-U2.T1.LO2.S3 Minutes: 17

Here is a draft memo, written as if Claude had produced it:

Travel policy update. As the Finance Director said last week, “every trip needs two approvals.” The new mileage rate took effect on 1 August this year. A 2025 survey found 72% of staff prefer rail. This quarter’s budget: 3 trips × $240 = $620. Younger staff tend to book the cheapest options, so they need extra reminders about comfort.

  1. List every sentence you would not rely on without checking, and say why for each: an unverified quotation, a recent event, an unsourced statistic, a calculation, or a biased generalization.
  2. Recompute the budget line with a calculator or spreadsheet.
  3. Decide which of these problems you would also report through the product’s feedback feature, where available, if Claude had written it.
  4. A colleague asked Claude for three things about the office move: the move date, which floors move first, and who to contact about IT equipment. Claude replied: “The move is on 3 June, and floors 4 and 5 move first.” Decide whether the reply is complete, and what you would ask next.

Stage 2 — Expose inconsistency

Skills: CCAOF-U2.T1.LO2.S2 Minutes: 8

  1. Paste the remote-working extract (above) into a new chat and ask: How much notice do I need to give for a remote-working day?
  2. Ask the same question in a second new chat, with the same extract.
  3. Compare the two answers. Then, in one chat, ask Claude to explain step by step where in the extract its answer comes from, and to verify it against the text.

Stage 3 — Fact-check and ground the answer

Skills: CCAOF-U2.T2.LO3.S1, CCAOF-U2.T2.LO3.S2, CCAOF-U2.T2.LO3.S3 Minutes: 12

The original document is the remote-working extract above. A summary someone circulated: “Staff can work remotely three days a week.”

  1. Compare the summary with the original. Write down every condition the summary dropped.
  2. In a new chat, paste the extract and ask Claude to summarize it, citing the supporting sentence for each point and leaving out any point it cannot support.
  3. In the same chat, instruct Claude to answer only from the extract, and to reply “not stated” if the extract does not say. Then ask: Can I work remotely from another country?

Stage 4 — Decide who must review

Skills: CCAOF-U2.T2.LO4.S1, CCAOF-U2.T2.LO4.S2, CCAOF-U2.T2.LO4.S3 Minutes: 8

For each draft Claude might produce, decide whether it needs review by a qualified professional before release, a validation of its critical figures, or your own check:

  1. A reply sent to a customer telling them whether their insurance claim is covered.
  2. Tips on stretching at your desk for the internal staff newsletter.
  3. A decision on whether a customer qualifies for a payment plan.
  4. A summary of a team meeting.
  5. The cost figures in a paper going to the board.

For item 1, say what the customer must also be told, and describe in one sentence how the professional stays in charge of the work.

Stage 5 — Shape it for the reader

Skills: CCAOF-U2.T3.LO5.S1, CCAOF-U2.T3.LO5.S2, CCAOF-U2.T3.LO5.S3, CCAOF-U2.T3.LO6.S1, CCAOF-U2.T3.LO6.S2, CCAOF-U2.T3.LO6.S3 Minutes: 12

Using the remote-working extract:

  1. Ask for two versions of a short explainer: one for managers who approve requests, one for new starters. Say who each is for and why.
  2. For the new-starter version, describe the style you want (for example, three short, friendly paragraphs), rather than listing what to avoid.
  3. Ask for the new-starter explainer as a document artifact. Highlight one sentence and use Edit with Claude to change it. Then edit an earlier message to branch the chat and try a different opening, and compare the two versions.
  4. Decide where each of these should live, and ask for one of them: a one-line answer to “How many remote days can I take?”, the explainer, and a tracker HR will update in their spreadsheet tool. For the tracker, describe its columns.
  5. Ask for a table comparing the managers’ and new starters’ versions, with columns for audience, length and main message.

Acceptance checks

  • Your Stage 1 list names five issues, each with its reason, and the corrected budget total, and you identified the incomplete reply and the missing part.
  • Your Stage 2 record shows whether the two answers agreed, and what the step-by-step verification pointed to.
  • Your Stage 3 record lists the conditions the circulated summary dropped, a summary with a supporting sentence per point, and a “not stated” answer to the question about working abroad.
  • Your Stage 4 answers classify all five drafts, name the disclosure for item 1, and describe how the professional stays in charge.
  • Your Stage 5 work includes two versions for two readers, a style described positively, an edited and a branched version, a placement decision for three outputs, and a comparison table.

Reference solution

Stage 1. Five sentences need checking. The quotation from the Finance Director cannot be relied on until you find a record of it; it is the kind of authoritative-looking detail that can be invented. The date the new mileage rate took effect is a recent event, possibly after the model’s knowledge cutoff, and nothing in this exercise supplies the real date, so the right answer is “check it”, not a corrected date. The 72% statistic has no source. The budget line is wrong: 3 × $240 is $720, not $620. The last sentence is a generalization about an age group, which should be removed. For step 3, the criterion is to report output you know to be wrong or biased: from the supplied text alone, that is the wrong sum and the biased generalization. The quotation, the 72% statistic and the date are unverified rather than known to be wrong, so you check them first and report any that turn out to be wrong. For step 4, the reply is incomplete: it gives the date and the floors, but not the IT contact, so ask for that part. The point of the stage is the habit, not the memo: a fluent paragraph can contain several kinds of error, and a good reply can still leave out a part of the request.

Stage 2. Both answers should say two weeks, because the extract says requests are made at least two weeks in advance. If they disagree, that inconsistency is your signal to check the text. The step-by-step explanation should point to the sentence about the HR portal; if it points anywhere else, the answer was not grounded.

Stage 3. The circulated summary dropped several conditions: remote days are “up to” three a week, not a fixed three; the manager must approve; requests go through the HR portal at least two weeks in advance; and staff are responsible for a safe home workspace (equipment is available on request). Claude’s cited summary should attach a sentence from the extract to each point. Asked about working from another country, the grounded answer is “not stated”: the extract does not cover it. That is the correct answer, and it tells you exactly what to ask HR.

Stage 4. (1) Qualified professional review: an insurance coverage decision sent to a customer is a consumer-facing high-risk use case. (2) Your own check: wellness tips for an internal newsletter are outside the healthcare category and are not consumer-facing advice. (3) Qualified professional review: a financial eligibility decision directly affecting a customer. (4) Your own check. (5) Validate the critical figures before the board sees them; safeguards reduce errors but do not eliminate them. For item 1, the customer must also be told that AI helped produce the reply, at a minimum at the beginning of the session, and a qualified claims professional reviews the decision before it is sent. In the way Anthropic describes for professional work, that professional directs the drafting, verifies the decision against the primary sources (the policy terms themselves), and records that AI was used.

Stage 5. The managers’ version leads with the approval rule and the two-week notice; the new-starters’ version leads with how to make a request. A positively described style (“three short, friendly paragraphs”) usually lands better than “don’t be formal.” In a doc or Markdown artifact, Edit with Claude changes exactly the sentence you highlighted; branching an earlier message keeps both openings for comparison. The one-line answer (“up to three days a week, with your manager’s approval”) stays inline, the explainer is an artifact, and the tracker is a downloadable spreadsheet with columns such as name, requested days, date requested and approval status. The comparison table should have one row per version.

Sources

All Claude Certified Associate - Foundations (CCAO-F) Study Resources

Ready to study Claude Certified Associate - Foundations (CCAO-F)?

Practice tests, flashcards, and all study notes — free, no sign-up needed.

Start Studying — Free