19Evidence A

Test yourself using questions based on how you’ll use the material later; don’t just recite it verbatim

Testing yourself after closing the book offers benefits beyond simply memorizing a few words. A meta-analysis of 192 comparisons involving over 10,000 participants showed that this method works moderately well for different question types, application problems, and reasoning tasks. However, it’s largely ineffective in two scenarios: when the question–answer pairing is reversed, and when the content has only ever been seen in the book without any prior testing.

Cost

There’s no expense involved, nor does it require extra tim…

Benefit

This meta-analysis examined over 40 years of research, drawing from 67 published and unpublished papers, 122 e…

Cost

There’s no expense involved, nor does it require extra time. The only change is the practice method: replace “reciting it verbatim” with “creating questions based on future usage.” The real challenge is figuring out exactly how you’ll apply this material later on.

Benefit

This meta-analysis examined over 40 years of research, drawing from 67 published and unpublished papers, 122 experiments, and 192 measures of transfer effects involving 10,382 participants total. Compared to simply reviewing material without testing, practice testing led to measurable learning transfer, with an effect size of d = 0.40 (95% CI 0.31–0.50). Transfer was strongest when participants answered questions of a different type, application or reasoning problems, or medical‑diagnosis‑style queries involving similar concepts. Transfer was weakest when the stimulus–response pairing was reversed, when material had only been encountered but never tested, or when dealing with example‑style problems. Factors such as whether the practice and test formats matched, whether detailed feedback was provided, and whether participants answered correctly on the initial test all strongly influenced whether positive transfer occurred. Two separate methods were used to correct for publication bias; while these adjustments modestly affected effect sizes, they substantially lowered the baseline intercept value. Under these conditions, positive transfer is often not observed at all.

Original sources

Pan SC, Rickard TC (2018). Transfer of test-enhanced learning: meta-analytic review and synthesis. Psychological Bulletin, 144(7), 710-756. https://doi.org/10.1037/bul0000151

Open source link
Book note

The term “memorization” usually bundles two distinct activities: repeatedly reading or highlighting material, and actively recalling it after closing the book. The former receives the lowest rating in a review that ranked ten learning strategies; for those ratings themselves, see item 16 (avoid relying on highlighting, repeated reading, or summarization as primary methods). What matters here is the latter: actively recalling information without looking at the source, as described in item 14 (self‑testing after closing the book). This practice should also be spread across several days, as noted in item 15 (distributed practice). Begin by determining how you’ll ultimately use the material—whether you’ll need to select answers on a test or make judgments in a real‑world setting—and then create questions that mirror those situations. It’s also valuable to reverse the question–answer order during practice, because the meta‑analysis showed that transfer is weakest in that direction; both orientations should be practiced.

My note