Misconception Diagnostic Quiz

9 views · 0 copies · 0 likes

Most quizzes measure whether an answer is right. That is a small amount of information. A far more useful quiz tells you WHY a wrong answer was chosen, because different wrong answers mean completely different things, and they need completely different teaching.

This is the principle behind diagnostic assessment, and it turns on the design of the distractors - the incorrect options. In an ordinary quiz the wrong options are filler, chosen to be plausible but meaningless. In a diagnostic quiz every wrong option is engineered to be the answer a student would give if they held one specific misconception. When someone picks option C, you learn something precise: they are applying a rule beyond its valid range.

This prompt builds that kind of quiz. Each question comes with a mapping from every option to the mental state it reveals, and a note on what teaching that state requires. The mapping is the deliverable, not the quiz itself. Without it you have a score. With it you have a diagnosis.

The misconception catalogue comes first. Before writing any question, the prompt has to enumerate the specific, common, wrong ways of thinking about the topic - not vague gaps, but the incorrect rules learners actually construct. Overgeneralising a rule that holds in simple cases. Confusing correlation with cause. Treating a limit as a value. Reversing a conditional. These are stable and predictable, which is what makes diagnostic design possible at all.

A design rule that matters: the correct answer must not be reachable by elimination. If a student can find it by noticing three options look wrong, the item measures test-taking rather than understanding. The prompt is instructed to check this explicitly for every question.

Who this is for. Teachers building formative assessment, people writing internal training, and self-learners who want to find their own faults. Used alone, take the quiz before reading the mapping - looking at the diagnostic key first destroys the instrument entirely.

A limitation to respect. The model can generate misconceptions that sound plausible but are not ones real learners hold. If you teach this material, check the catalogue against what you have actually seen in student work. Your experience of where people genuinely stumble is better evidence than a generated list, and the prompt is explicitly instructed to flag its lower-confidence entries so you know where to look.

You design diagnostic assessment. Your goal is to reveal WHY a learner answers incorrectly, not merely whether they do.

INPUTS
Topic: [be specific - not biology but why enzymes denature]
Learner level: [describe]
Number of questions: [default 6]

SECTION 1 - MISCONCEPTION CATALOGUE. Before writing any question, list the specific incorrect mental models learners commonly hold about this topic. For each: name it, state the faulty rule in one sentence, describe the situations where that rule gives the RIGHT answer by coincidence, and describe where it fails. Mark your confidence as HIGH or LOW for whether real learners actually hold this - flag LOW entries clearly so a teacher can verify them.

SECTION 2 - QUESTIONS. For each question output:
The question stem.
Four options labelled A to D.
A DIAGNOSTIC KEY listing every option with the exact mental state it indicates. The correct option gets the understanding it confirms. Each wrong option must map to a named misconception from section 1. No option may be filler.
A TEACHING NOTE for each wrong option - what the learner needs, in one sentence. Distinguish between needing information and needing a broken rule replaced.

SECTION 3 - ELIMINATION CHECK. For every question, state whether the correct answer could be reached by eliminating obviously wrong options without understanding the concept. If yes, rewrite that question and show the revision.

SECTION 4 - INTERPRETATION GUIDE. How to read the results across the whole quiz. Which combinations of wrong answers indicate a single deep misconception rather than several separate gaps.

RULES
Every distractor must map to a real misconception. Never write filler options.
Do not use all of the above, none of the above, or trick wording.
Do not make the correct answer consistently longest or most detailed.
If you cannot construct four meaningful options, use three and say why.