Catch a wrong multiplication answer from ChatGPT while checking homework
- Posted
- by Treehouse Dad (@treehousedad)
- Last checked
- Method:
- How we verify
Evidence: Screenshots or logsThe source shows screenshots, a transcript or the agent's output.
FailureThe source says the agent did not get the job done.
What went wrong: ChatGPT gave a wrong answer to a simple multiplication; the poster caught it with a calculator.
Outcome
Helping their son with homework, the poster had ChatGPT (GPT-5) do a simple multiplication problem. They couldn't reproduce its answer, checked with a calculator, and found ChatGPT was wrong.
Agent
Prompt Recreated prompt
The source didn't share its exact prompt, so we wrote this from what it describes.
Run this task now, exactly as written below. Everything you need is here, so start straight away and only stop if something required is missing or a rule below tells you to. Goal: Help me check my child's math homework, showing your working so I can verify every answer. Fill in before running: - The problems: [PROBLEMS] - My child's answers: [ANSWERS] Rules: - Show each step of the calculation, not just the final answer. - Say clearly which of my child's answers match and which don't. - For any arithmetic, tell me to confirm the result with a calculator. - Explain mistakes in a way a child can follow. - Check facts that can change (prices, opening hours, dates, availability, rules) against the official source, and tell me anything you couldn't verify. Output: A line-by-line check with working, and a short note on any mistakes. You'll know it worked when: every answer is confirmed by the working and a calculator.
Customize this prompt
Answer these questions and we'll put your answers into the prompt for you. You can leave any of them empty.
Your prompt
Run this task now, exactly as written below. Everything you need is here, so start straight away and only stop if something required is missing or a rule below tells you to. Goal: Help me check my child's math homework, showing your working so I can verify every answer. Fill in before running: - The problems: [PROBLEMS] - My child's answers: [ANSWERS] Rules: - Show each step of the calculation, not just the final answer. - Say clearly which of my child's answers match and which don't. - For any arithmetic, tell me to confirm the result with a calculator. - Explain mistakes in a way a child can follow. - Check facts that can change (prices, opening hours, dates, availability, rules) against the official source, and tell me anything you couldn't verify. Output: A line-by-line check with working, and a short note on any mistakes. You'll know it worked when: every answer is confirmed by the working and a calculator.
Scroll to see the whole prompt. Your answers show in green.
2 blanks are still empty: The problems; My child's answers. They'll stay in brackets in your prompt, so the chat tool may ask you about them.
What you type stays in this browser tab. We don't send it or save it, and it's gone when you leave the page. If you use a "Try this in" button, your answers go to that tool as part of the prompt.
Try this in:
This prompt has blanks to fill in, like [PROBLEMS]. We'll copy it instead of filling it in, so you can edit it before you send.
Opens in a new tab. We don't see what you send.
These links are only a shortcut. We're not affiliated with OpenAI, Google or xAI, and your results may not match the source.
Optional stronger version
Our rewrite with extra checks. The poster didn't test it.
Run this task now, exactly as written below. Everything you need is here, so start straight away and only stop if something required is missing or a rule below tells you to. Goal: Help me check my child's math homework, showing your working so I can verify every answer. Fill in before running: - The problems: [PROBLEMS] - My child's answers: [ANSWERS] Rules: - Show each step of the calculation, not just the final answer. - Say clearly which of my child's answers match and which don't. - For any arithmetic, tell me to confirm the result with a calculator. - Explain mistakes in a way a child can follow. - Check facts that can change (prices, opening hours, dates, availability, rules) against the official source, and tell me anything you couldn't verify. - If you're unsure of any result, say so instead of giving a confident number. Output: A line-by-line check with working, and a short note on any mistakes. You'll know it worked when: every answer is confirmed by the working and a calculator. Before you finish: re-read my goal and constraints, check your answer against each one, and list anything you assumed or couldn't confirm.
Source
https://x.com/treehousedad/status/1960402697993249262
Related cases
- Catch an error in a 4th-grader's textbook answer key, which ChatGPT first got wrong too (failure)Recreated promptEvidence: Screenshots or logsFailure
Carlos Mendoza's 4th-grade son marked only B and F as correct in a Santillana exercise on numbers up to the billions. The platform's solution marked B, D and F, but D said '9,615 rounded to the billions is 10,000', which is false. When Mendoza asked ChatGPT to review it, it first said Santillana was right, reading 'billions' as if it were 'thousands'. Only when Mendoza pointed to the exact word did ChatGPT acknowledge the error. The son had been right from the beginning.
ChatGPT · Personal · Source date:
- Check a kindergartener's math worksheets and make harder practice problems with ChatGPTEvidence: Screenshots or logsBeginner-friendly
On a snow day, a parent uploaded his five-year-old's two completed math worksheets to ChatGPT, asking it to act as his kindergarten teacher, check the answers, give feedback and create more challenging problems if needed. ChatGPT marked all the answers correct and suggested moving on to addition within 20, missing-number problems and two-step word problems.
ChatGPT · Personal · Source date:
- Get homework broken into small steps for a teen with ADHD and dyslexia with ChatGPTEvidence: Described by posterBeginner-friendly
Elly Walsh's teenage daughter has ADHD and dyslexia, and the family had been worried about her falling behind. Instead of banning ChatGPT for homework, Walsh had her type a prompt asking it to break the work down step by step for how her brain works. It split the work into short steps with clear explanations, one thing at a time, and Walsh says their daughter sat calm and focused, working through it slowly instead of having another meltdown.
ChatGPT · Personal · Source date: