Items / Reference templates / BP006

REF-BP006-0

C03 independence · C03.1 test independence from table · target medium, CD4 · split test · reference items carry their template's native demand and difficulty

Pending

In an airline study, 500 passengers were classified. Among the 200 frequent flyers, 60 check a bag; among the 300 occasional flyers, 90 check a bag. Is being a frequent flyer independent of whether a passenger checks a bag?

  1. ANo, because P(check a bag | frequent flyers) = 0.3 differs from P(check a bag) = 0.3.MISC-OTHER
  2. BYes, because P(check a bag | frequent flyers) = 0.3 equals P(check a bag) = 0.3.Key
  3. CNo, because a passenger cannot be both a frequent flyer and an occasional flyer, so the events are mutually exclusive and therefore dependent.M-INDEP-VS-EXCL
  4. DYes, because the two groups were sampled separately, so their results cannot influence each other.M-INDEP-VS-EXCL

Explanation (as written by the item's author)

Independence requires P(check a bag | frequent flyers) = P(check a bag). Here these are 0.3 and 0.3, so the events are independent.

Distractors and the misconception each claims to execute
OptionCodeCatalogue meaningAuthor's rationale
AMISC-OTHERDistractor is not attributable to any catalogued misconception (itself a quality signal).States the correct comparison but draws the opposite conclusion from it.
B (key)KEYCompares the conditional probability with the marginal, which is the definition.
CM-INDEP-VS-EXCLTreats mutually exclusive events as independent, or independence as exclusivity.Confuses mutual exclusivity of the two groups with dependence between the variables.
DM-INDEP-VS-EXCLTreats mutually exclusive events as independent, or independence as exclusivity.Confuses independence of sampling procedure with independence of events.

Quality flags · 0 fired

  • duplicate options (integrity) not firedTwo options are identical after normalisation.
  • numerically equal options (integrity) not firedTwo options denote the same number (e.g. 0.5 and 1/2 and 50%).
  • missing options (integrity) not firedFewer than four non-empty options.
  • key out of range (integrity) not firedThe keyed answer is a probability outside [0, 1] (or a percentage > 100).
  • all none of above (cue) not firedAn option is 'all/none of the above' or 'both A and B'.
  • key uniquely longest (cue) not firedThe key is the longest option by at least 20% (length cue).
  • key uniquely shortest (cue) not firedThe key is the shortest option by at least 20%.
  • distractor out of range (cue) not firedA distractor is a probability outside [0, 1]; it can be eliminated without the construct.
  • absolute terms in distractors (cue) not firedDistractors (only) use absolute terms such as always/never/must/proves, a known cue that they are wrong.
  • stem option overlap cue (cue) not firedThe key alone repeats a content word from the stem.
  • grammatical mismatch (cue) not firedThe stem ends in 'a'/'an' and some options do not agree with it.
  • key is hedged only (cue) not firedOnly the key contains hedging language (may/might/plausibly/likely).
  • numeric middle key (info) not firedOptions are numeric and the key is one of the two middle values. Informational; tested at set level against the 0.5 chance rate.
  • negative stem (style) not firedStem uses NOT/EXCEPT/LEAST phrasing.
  • overlong stem (style) not firedStem exceeds 110 words.
  • inconsistent numeric format (style) not firedNumeric options mix fractions, decimals and percentages, or use differing decimal precision.
  • unit mismatch (style) not firedOptions carry different units.
  • option length imbalance (style) not firedLongest option is more than 2.5x the shortest.
  • rationale value mismatch (metadata) not firedA distractor's stated rationale computes a value ('= x') that is not the option it is attached to: the distractor does not actually execute the misconception it claims.

Validator output

Not a numeric item: no program-of-thought check applies.

Answering probes

Probes not yet run for this item.

Shortcut results

Construct-free heuristics (probability on the key; chance 0.25)
HeuristicP(key)
longest option0.00
shortest option1.00
convergence1.00
stem overlap0.00
numeric middle0.25
hedged option0.50
position prior0.00

Provenance and generation trace

Method
reference_template /
Model
none
Source
parameterised template T-C03.1-indep-table, written by the AssessAI build agent (Claude); no external item bank; not human-reviewed
Prompt hash
LLM calls · cost
0 · $0.00000 · 0.0 s
Parser notes
none