Spaced Repetition Meets Curriculum Learning
Humans and neural networks are wildly different systems, yet the scheduling of their learning rhymes. This note lines up two ideas that turn out to be cousins.
On the human side: spaced repetition
People retain more when exposures are spaced over time and ordered from easier to harder. The schedule adapts to the learner: items you find hard come back sooner; items you’ve mastered drift to long intervals. (See The Spacing Effect and Retrieval Practice.)
On the machine side: curriculum learning
Curriculum learning is the finding that models often train better when examples are presented in a meaningful order — easy concepts first, hard ones later — rather than uniformly at random. Like a good syllabus, it shapes the path the optimizer takes.
The shared pattern
| Humans | Machines | |
|---|---|---|
| Order | easy → hard | easy → hard (curriculum) |
| Timing | space reviews over time | replay / rehearsal buffers |
| Adaptivity | review weak items sooner | sample hard examples more |
| Failure mode | cramming → fast forgetting | too-high learning rate → instability |
The deep commonality: learning is path-dependent. What you study isn’t the only thing that matters — when and in what order changes the outcome, for brains and for gradient descent alike.
Open question for this project
If forgetting follows the same exponential skeleton in both systems, how far can we push the analogy? Which human study techniques have a genuine machine-learning twin, and which are coincidences of vocabulary? That’s exactly the kind of thing this site exists to map.
📄 Raw source for this note lives in the corpus: /llms-full.txt