"Make It Stick", Peter C Brown

This is an excellent book on effective learning, memorization, and mastery. The key concepts are straightforward and often seem obvious, yet they are surprisingly absent in many areas of our lives. The book is packed with practical advice and examples from diverse fields, including education, sports, and business. I plan to apply some of these tips to strengthen my own learning, enhance my reading approach, and, of course, improve my teaching and courses. Here are my notes on Make It Stick by Peter C. Brown.

On retrieval practice and spaced repetition

When the mind has to work, learning sticks better.
“Retrieval practice” means self-quizzing. Retrieving knowledge and skill from memory should become your primary study strategy in place of rereading.
When retrieval practice is spaced, allowing some forgetting to occur between tests, it leads to stronger long-term retention than when it is massed.
Spacing out your practice feels less productive for the very reason that some forgetting has set in and you’ve got to work harder to recall the concepts. It doesn’t feel like you’re on top of it. What you don’t sense in the moment is that this added effort is making the learning stronger.
How big an interval, you ask? The simple answer: enough so that practice doesn’t become a mindless repetition. At a minimum, enough time so that a little forgetting has set in. A little forgetting between practice sessions can be a good thing, if it leads to more effort in practice, but you do not want so much forgetting that retrieval essentially involves relearning the material. The time periods between sessions of practice let memories consolidate. Sleep seems to play a large role in memory consolidation, so practice with at least a day in between sessions is good.
The basic idea is that varied practice—like tossing your beanbags into baskets at mixed distances—improves your ability to transfer learning from one situation and apply it successfully to another. You develop a broader understanding of the relationships between different conditions and the movements required to succeed in them; you discern context better and develop a more flexible “movement vocabulary”—different movements for different situations.

On interleaving

Interleaving two or more subjects during practice also provides a form of spacing. Interleaving can also help you develop your ability to discriminate later between different kinds of problems and select the right tool from your growing toolkit of solutions.
In interleaving, you don’t move from a complete practice set of one topic to go to another. You switch before each practice is complete. A friend of ours describes his own experience with this: “I go to a hockey class and we’re learning skating skills, puck handling, shooting, and I notice that I get frustrated because we do a little bit of skating and just when I think I’m getting it, we go to stick handling, and I go home frustrated…”
…This is actually the rare coach who understands that it’s more effective to distribute practice across these different skills than polish each one in turn. The athlete gets frustrated because the learning’s not proceeding quickly, but the next week he will be better at all aspects, the skating, the stick handling, and so on, than if he’d dedicated each session to polishing one skill.

Spacing, interleaving, and variability are natural features of how we conduct our lives. Every patient visit or football game is a test and an exercise in retrieval practice.

On quizzing

Giving students corrective feedback after tests keeps them from incorrectly retaining material they have misunderstood and produces better learning of the correct answers.
Students in classes that incorporate low-stakes quizzing come to embrace the practice. Students who are tested frequently rate their classes more favorably.

Mass practice vs effortful learning

We harbor deep convictions that we learn better through single-minded focus and dogged repetition, and these beliefs are validated time and again by the visible improvement that comes during “practice-practice-practice.” But scientists call this heightened performance during the acquisition phase of a skill “momentary strength” and distinguish it from “underlying habit strength.” The very techniques that build habit strength, like spacing, interleaving, and variation, slow visible acquisition and fail to deliver the improvement during practice that helps to motivate and reinforce our efforts.
Blocked practice—that is, mastering all of one type of problem before progressing to practice another type—feels (and looks) like you’re getting better mastery as you go, whereas interrupting the study of one type to practice a different type feels disruptive and counterproductive. Even when learners achieve superior mastery from interleaved practice, they persist in feeling that blocked practice serves them better. You may also experience this feeling, but you now have the advantage of knowing that studies show that this feeling is illusory.
Massed practice feels more productive than spaced practice, but it is not. Spaced practice feels more difficult, because you have gotten a little rusty and the material is harder to recall. It feels like you’re not really getting on top of it, whereas in fact, quite the opposite is happening: As you reconstruct learning from long-term memory, as awkward as it feels, you are strengthening your mastery as well as the memory.
Examples include relating the material to what you already know, explaining it to somebody else in your own words, or explaining how it relates to your life outside of class.

On reflection

Some people never seem to learn. One difference, perhaps, between those who do and don’t is whether they have cultivated the habit of reflection. Reflection is a form of retrieval practice (What happened? What did I do? How did it work out?), enhanced with elaboration (What would I do differently next time?).
Most important is to make frequent use of testing and retrieval practice to verify what you really do know versus what you think you know. Frequent low-stakes quizzes in class help the instructor verify that students are in fact learning as well as they appear to be and reveal the areas where extra attention is needed.
…Cultivating the habit of reflecting on one’s experiences, of making them into a story, strengthens learning. The theory of structure building may provide a clue as to why: that reflecting on what went right, what went wrong, and how might I do it differently next time helps me isolate key ideas, organize them into mental models, and apply them again in the future with an eye to improving and building on what I’ve learned.
Embrace the notion of successful intelligence. Go wide: don’t roost in a pigeonhole of your preferred learning style but take command of your resources and tap all of your “intelligences” to master the knowledge or skill you want to possess.
Distill the underlying principles; build the structure. If you’re an example learner, study examples two at a time or more, rather than one by one, asking yourself in what ways they are alike and different. Are the differences such that they require different solutions, or are the similarities such that they respond to a common solution?
Adopt active learning strategies like retrieval practice, spacing, and interleaving. Be aggressive. Like those with dyslexia who have become high achievers, develop workarounds or compensating skills for impediments or holes in your aptitudes.
Pause periodically and ask what the central ideas are, what the rules are. Describe each idea and recall the related points. Which are the big ideas, and which are supporting concepts or nuances? If you were to test yourself on the main ideas, how would you describe them?
Reflection is the act of taking a few minutes to review what has been learned in a recent class or experience and asking yourself questions. What went well? What could have gone better? What other knowledge or experiences does it remind you of? What might you need to learn for better mastery, or what strategies might you use the next time to get better results? For instance: The biology professor Mary Pat Wenderoth assigns weekly low-stakes “learning paragraphs” in which students are asked to reflect on what they learned the previous week and to characterize how their class learning connects to life outside the class. This is a fine model for students to adopt for themselves and a more fruitful learning strategy than spending hours transcribing lecture slides or class notes verbatim into a notebook.

On brain capacity and growth mindset

Research and the modern record have shown that we and our brains are capable of much greater feats than scientists would have thought possible even a few decades ago.

“From the time a child enters first grade, through high school, college, and beyond, there is little change in the number of synapses. It is during the time when no, or little, synapse formation occurs that most learning takes place” and we develop adult-level skills in language, mathematics, and logic.

When you praise for intelligence, kids get the message that being seen as smart is the name of the game. “Emphasizing effort gives a child a rare variable they can control,” Dweck says. But “emphasizing natural intelligence takes it out of a child’s control, and it provides no good recipe for responding to a failure.”
…that more than IQ, it’s discipline, grit, and a growth mindset that imbue a person with the sense of possibility and the creativity and persistence needed for higher learning and success. “Study skills and learning skills are inert until they’re powered by an active ingredient,” Dweck says. The active ingredient is the simple but nonetheless profound realization that the power to increase your abilities lies largely within your own control.
Learning is at least a three-step process: initial encoding of information is held in short-term working memory before being consolidated into a cohesive representation of knowledge in long-term memory. Consolidation reorganizes and stabilizes memory traces, gives them meaning, and makes connections to past experiences and to other knowledge already stored in long-term memory. Retrieval updates learning and enables you to apply it when you need it.
Trying to come up with an answer rather than having it presented to you, or trying to solve a problem before being shown the solution, leads to better learning and longer retention of the correct answer or solution, even when your attempted response is wrong, so long as corrective feedback is provided.
If doing something repeatedly might be considered practice, deliberate practice is a different animal: it’s goal directed, often solitary, and consists of repeated striving to reach beyond your current level of performance.
With continued retrieval, complex material can become second nature to a person and the mnemonic cues are no longer needed: you consolidate concepts like Newton’s 3 laws of motion into mental models that you use as a kind of shorthand. Through repeated use, your brain encodes and “chunks” sequences of motor and cognitive actions, and your ability to recall and apply them becomes as automatic as habit.
We make the effort because the effort itself extends the boundaries of our abilities. What we do shapes who we become and what we’re capable of doing. The more we do, the more we can do. To embrace this principle and reap its benefits is to be sustained through life by a growth mindset.
Repeated effortful recall or practice helps integrate learning into mental models, in which a set of interrelated ideas or a sequence of motor skills are fused into a meaningful whole that can be adapted and applied in later settings.
So take a page from McPhee: when you want to master something new, delete the whimpering and go wrestle the bear.

On teaching and training

Students labor under many myths and illusions about learning that cause them to make some unfortunate choices about intellectual risk taking and about when and how to study. It’s the proper role of the teacher to explain what empirical studies have discovered about how people learn, so the student can better manage his or her own education.
To achieve excellence in any sphere, you must strive to surpass your current level of ability. Striving, by its nature, often results in setbacks, and setbacks are often what provide the essential information needed to adjust strategies to achieve mastery.
Space, interleave, and vary topics and problems covered in class so that students are frequently shifting gears as they have to “reload” what they already know about each topic in order to figure out how the new material relates or differs.

“This is about having very high expectations across multiple dimensions and keeping them real busy,” Matthews, says. In fact, as stunning as it sounds, Matthews will tell a student, “If you’ve read every word of this chapter, you’re not being very efficient.” The point is not to “slide your eyes over the words.” You start with questions, and you read for answers.

Clear learning objectives prior to each class, coupled with daily quizzing and active problem solving with feedback, keep students focused, awake, and working hard.
How to shoot an azimuth. It’s a skill used for keeping your bearings in unfamiliar territory. You climb a tree or a height of land and sight a distant landmark in the direction you’re headed. Compass in hand, you note how many degrees your landmark lies off of due north. Then you descend into the bush and keep working your way in that direction. Periodically, you pause to shoot an azimuth and make sure you’re on course. Quizzing is a way of shooting an azimuth in the classroom: are you gaining the mastery you need to get where you’re trying to go?
A good example from sports team training (note: they are using slo-mo training)

With all this to be done, it’s not surprising that a critical aspect of the team’s success is a very specific daily and weekly schedule that interleaves the elements of individual and team practice. The start of every day’s practice is strictly focused on the fundamentals of each player’s position. Next, players practice in small groups, working on maneuvers involving several positions. These parts are gradually brought together and run as a team. Play is speeded up and slowed down, rehearsed mentally as well as physically. By midweek the team is running the plays in real time, full speed.

Other techniques

ELABORATION improves your mastery of new material and multiplies the mental cues available to you for later recall and application of it (Chapter 4). What is it? Elaboration is the process of finding additional layers of meaning in new material.
CALIBRATION is the act of aligning your judgments of what you know and don’t know with objective feedback so as to avoid being carried off by the illusions of mastery that catch many learners by surprise at test time. What is it? Everyone is subject to a host of cognitive illusions, some of which are described in Chapter 5.
GENERATION has the effect of making the mind more receptive to new learning. What is it? Generation is an attempt to answer a question or solve a problem before being shown the answer or the solution. For instance: On a small level, the act of filling in a missing word in a text (that is, generating the word yourself rather than having it supplied by the writer) results in better learning and memory of the text than simply reading a complete text.
MNEMONIC DEVICES help you to retrieve what you have learned and to hold arbitrary information in memory (Chapter 7). What are they? “Mnemonic” is from the Greek word for memory, and mnemonic devices are like mental file cabinets. They give you handy ways to store information and find it again when you need it. For instance: Here is a very simple mnemonic device that some schoolchildren are taught for remembering the US Great Lakes in geographic order, from east to west: Old Elephants Have Musty Skin.