Curriculum·G702 Pedagogical Fundamentals·about 32 min
Metacognition: teaching people to know what they know
By the end of this lesson you can
- →Describe the 2008 experiment in which learners rated the worse technique as better after seeing their own results, and state why the judgment resisted the evidence
- →Distinguish confidence from calibration, and explain why only calibration can be measured and taught
- →Compute a learner's calibration from a set of recorded predictions, and read the curve for over-confidence, under-confidence and no discrimination
- →Run a lesson so that every learner records a confidence before an answer, and use the Academy's calibration items and baseline as the instrument
Graduate · enrolled learners
This lesson opens with Learning Concepts and Categories: Is Spacing the Enemy of Induction? 2008.
- What happened
- Nate Kornell and Robert Bjork had participants study paintings by twelve artists in order to learn to recognize each artist's style. Some artists' paintings were presented consecutively, massed, and others were interleaved with other artists' work, spaced. On a later test of classifying new paintings by artist, spacing produced better performance. Asked which schedule had helped them learn more, participants rated massing as more effective, and most maintained that judgment even after completing the test and seeing that spacing had worked better for them. The paper's title asked whether spacing was the enemy of induction; the data said it was the friend, and the participants said the opposite.
- The decision point
- The learners were not uninformed. They had just taken the test and could see which condition they had done better in, and they still judged the smoother condition to have taught them more. The feeling of fluent learning during massed study was a stronger signal to them than their own results. That is a calibration failure: confidence and accuracy came apart, and confidence won. A learner who cannot tell what they know from what feels familiar will make the confident wrong decision at the moment it matters, and per this Academy's design that is why calibration is measured from the first hour and re-measured at the Senior gate rather than assumed.
What you will be able to answer
- →What did the 2008 painting study show?
- →Confidence versus calibration?
- →Over-confidence versus no discrimination on a curve?
- →Where is calibration measured in this Academy?
Orientation and Year One are open: anyone can read them without an account. From Year Two onward the lessons are for enrolled learners, because progress through the later years only means anything if it is tracked against a record.
It is free. We do not sell the list and there is nothing to buy at the end of it.
Sources and review
- https://journals.sagepub.com/doi/abs/10.1111/j.1467-9280.2008.02127.x
- https://pmc.ncbi.nlm.nih.gov/articles/PMC3978334/
- https://www.semanticscholar.org/paper/Learning-Concepts-and-Categories:-Is-Spacing-the-of-Kornell-Bjork/8c5a0879246f62b96f5f05746b6a0b6e4180e929
Confidence high·Volatility low·Reviewed 2026-09-14·Owner unassigned
Contested
Later work, including Wahlheim, Dunlosky and Jacoby (2011) and a 2014 reply titled 'Is spacing really the friend of induction?', found that the spacing advantage for category learning depends on the materials and on what the learner attends to, and that massing can help when within-category similarity is what needs to be learned. The lesson relies on the metacognitive finding, that learners judged the worse condition better after seeing their results, which those replies did not contest.
The calibration arithmetic in the worked example uses this Academy's own scorer, which implements the reading O100-04 teaches. The scorer's per-band curve and Brier score are one way of measuring calibration among several.