Items / Reference templates / BP003

REF-BP003-2

C01 conditional probability · C01.3 conditional vs joint · target medium, CD3 · split dev · reference items carry their template's native demand and difficulty

Pending

A researcher selects one patient at random from all patients in a clinic record review and finds that it is over 60 and that it reports side effects. Which expression gives the probability of that outcome for a randomly chosen patient?

  1. AP(over 60 and report side effects)Key
  2. BP(over 60 | report side effects)M-INV-COND
  3. CP(report side effects | over 60)M-JOINT-AS-COND
  4. DP(over 60) + P(report side effects)M-ADD-NOT-MULT

Explanation (as written by the item's author)

The unit was drawn from the entire population, so no conditioning has occurred; the probability of observing both attributes together is the joint probability.

Distractors and the misconception each claims to execute
OptionCodeCatalogue meaningAuthor's rationale
A (key)KEYThe selection is from the whole population, so both attributes are part of one outcome.
BM-INV-CONDInverts the conditional: reports P(B|A) when P(A|B) was asked (confusion of the inverse).Restricts to the other group and reverses the direction.
CM-JOINT-AS-CONDUses the joint probability P(A and B) where the conditional P(A|B) was required.Restricts the sample space to a group that was not used to select the unit.
DM-ADD-NOT-MULTAdds probabilities of independent events where multiplication is required (or vice versa).Adds probabilities of events that can occur together.

Quality flags · 0 fired

  • duplicate options (integrity) not firedTwo options are identical after normalisation.
  • numerically equal options (integrity) not firedTwo options denote the same number (e.g. 0.5 and 1/2 and 50%).
  • missing options (integrity) not firedFewer than four non-empty options.
  • key out of range (integrity) not firedThe keyed answer is a probability outside [0, 1] (or a percentage > 100).
  • all none of above (cue) not firedAn option is 'all/none of the above' or 'both A and B'.
  • key uniquely longest (cue) not firedThe key is the longest option by at least 20% (length cue).
  • key uniquely shortest (cue) not firedThe key is the shortest option by at least 20%.
  • distractor out of range (cue) not firedA distractor is a probability outside [0, 1]; it can be eliminated without the construct.
  • absolute terms in distractors (cue) not firedDistractors (only) use absolute terms such as always/never/must/proves, a known cue that they are wrong.
  • stem option overlap cue (cue) not firedThe key alone repeats a content word from the stem.
  • grammatical mismatch (cue) not firedThe stem ends in 'a'/'an' and some options do not agree with it.
  • key is hedged only (cue) not firedOnly the key contains hedging language (may/might/plausibly/likely).
  • numeric middle key (info) not firedOptions are numeric and the key is one of the two middle values. Informational; tested at set level against the 0.5 chance rate.
  • negative stem (style) not firedStem uses NOT/EXCEPT/LEAST phrasing.
  • overlong stem (style) not firedStem exceeds 110 words.
  • inconsistent numeric format (style) not firedNumeric options mix fractions, decimals and percentages, or use differing decimal precision.
  • unit mismatch (style) not firedOptions carry different units.
  • option length imbalance (style) not firedLongest option is more than 2.5x the shortest.
  • rationale value mismatch (metadata) not firedA distractor's stated rationale computes a value ('= x') that is not the option it is attached to: the distractor does not actually execute the misconception it claims.

Validator output

Not a numeric item: no program-of-thought check applies.

Answering probes

Probes not yet run for this item.

Shortcut results

Construct-free heuristics (probability on the key; chance 0.25)
HeuristicP(key)
longest option0.00
shortest option0.00
convergence0.00
stem overlap0.25
numeric middle0.25
hedged option0.25
position prior0.00

Provenance and generation trace

Method
reference_template /
Model
none
Source
parameterised template T-C01.3-joint, written by the AssessAI build agent (Claude); no external item bank; not human-reviewed
Prompt hash
LLM calls · cost
0 · $0.00000 · 0.0 s
Parser notes
none