Thursday, July 9, 2015

You Got Some Explaining To Do!: Self-explaining

Here's a fun question for you: How detailed is your mental model of a toilet? If I had to guess, I would say you generally know how a toilet works, but haven't written a thesis on the topic. To test yourself, read the following passage and try to assemble a mental model of the modern flushable toilet.
The toilet has several working components. The tank (or cistern) holds clean water, and it is located above the toilet bowl, which holds the flushable content. Connected to the tank is a handle that, when pressed, releases the water from the tank. Gravity drains the water into the bowl through a small cistern tube. The water then exits the bowl at the bottom through the S-trap. 
Inside the tank are several additional components that control the flow of water into and out of the tank. At the bottom of the tank is a flapper valve, which is connected to the handle by a chain. When the handle is pressed, the chain raises the flapper valve to let the water out. As the water level decreases, the float ball, which is connected to the float rod, drops and opens the inlet valve. When the inlet valve opens, clean water rushes in to fill the tank. When the water reaches the top of the tank, the float ball closes the inlet valve. 
There's a lot of information crammed into those paragraphs [1]; however, it is also the case that a lot of information is missing. For example, how does the float ball and rod open and close the inlet valve? To make sense of the description as currently written, you still have to do some work. First, you have to spatially assemble all of the components in your mind's eye as you learn about them. Second, you need to supply any information that may be missing. Finally, you might have to resolve contradictions that arise between the information you are learning and the mental model you are building as you engage in the first two activities [2].


What do good students do when learning something new? 

When students read a text about an unfamiliar topic, their first priority is to make sense of each and every word. Once they decode the words, their next task is to assemble them into larger chunks of meaningful information. For example, you probably know what the words handle, chain, and tube mean. But you need to connect all three concepts together to form a working model of the flush mechanism in a toilet. The mental process of hooking these concepts together is what we will call self-explaining, or the generation of inferences that are required to construct an accurate mental model.


Evidence for self-explaining was first observed by asking students to read a passage about a branch of physics called statics [3]. In statics problems, balanced forces are acting on a body, which means there is no acceleration (see Fig. 1 for an example). Statics problems can become quite complex, as you can probably imagine. Researchers noticed that students who best understood statics were the ones who explained to themselves how to solve these types of problems. In other words, the best students naturally engaged in self-explaining. They also generated several self-explanation inferences to fill in the missing pieces of information that are not stated explicitly in the text. These missing pieces are necessary to fully understand the problem's solution.


Fig 1. An example statics problem.


Can you motivate students to self-explain? 

It's really interesting to read transcripts of students as they attempt to make sense of a complex topic. They might not understand it at first. But as they explain it to themselves, they are then able to see how to correct their current understanding with the model presented in the text. Good students naturally self-explain, but can we get all students to engage in self-explaining? The answer, as it turns out, is a qualified "yes." 

In one of the first studies to demonstrate that self-explaining can be prompted, researchers asked eighth grade students to read a passage about the human circulatory system [4]. Before students read the passage, the researchers asked them several questions about their understanding of the circulatory system. Because they were so young, it was no surprise that students generally had an impoverished understanding of the circulatory system. Most knew that the heart beats, but they didn't know why or what purpose the heart served. Some of the better students knew that the heart circulates blood, but they didn't understand pulmonary circulation. That is, they didn't realize that the heart has a special circuit of blood that goes to the lungs for oxygenation (and back).

After the pretest phase of the experiment, the students were asked to read a text passage that described, in detail, all of the steps of circulation. The student was verbally prompted by the experimenter to self-explain after reading each sentence of the text. After a while, merely turning the page was a prompt to self-explain. In other words, the researchers trained the students to self-explain, and then they reminded them over and over to self-explain. It was a pretty heavy-handed approach, but it worked. It paid off because the students who were prompted to self-explain demonstrated a more robust mental model of the circulatory system on the post-test than students in control condition who were only prompted to think about or reread the sentences.

Why was prompting students to self-explain a qualified success? Like most educational interventions, there were individual differences in the amount and effectiveness of the prompting. Some students generated several self-explanation inferences, whereas others generated only a few. Since the original study, researchers have designed new ways to help students become better self-explainers. For example, one study gave students an incorrect solution and asked students to debug the fictitious student's reasoning process [5]. This helped take the pressure off the student so that they could focus their attention on reconciling the differences between the correct and incorrect solution paths.


The STEM Connection

The connection between self-explanation and STEM education is extremely straightforward. Students should be trained on the definition of what self-explaining is. Then they should be prompted, periodically, to engage in self-explaining. To help them get started, here is a list of prompts that were used in the original study [4]: 

  1. What new information does each line provide for you?
  2. How does it relate to what you’ve already read?
  3. Does it give you a new insight into your understanding of how ______ works?
  4. Does it raise a question in your mind?

Also, students should be shown evidence of the utility of self-explaining. Students will probably be more likely to self-explain if they understand what it will eventually buy them. Moreover, students should be given an opportunity to develop the skill [6]. In fact, there is an intelligent tutoring system that was developed to do precisely that. The iSTART system gives students the opportunity to self-explain while reading complex textual passages [7]. Because self-explaining can be mentally taxing, the iSTART system was even outfitted with a bunch of mini-games to help build fluency in self-explaining [8].

Self-explaining is a powerful learning mechanism. It can be time-consuming and mentally exhausting, but the end result is definitely worth the effort. Like other concepts covered in this blog, self-explaining is a skill, which means it can become automatized over time. Thus, we need to get students started with self-explaining as early as possible because when they get to college, they will thank us for giving them the tools to make sense of tough concepts like organic chemistry (and flushable toilets). 


Share and Enjoy!

Dr. Bob

For More Information

[1] Here is the resource I consulted to write this description. To further enhance reading comprehension, it's typically to include a diagram. I intentionally omitted the diagram because I wanted you to attempt to assemble a mental model without a visual aid. 

[2] Chi, M. T. H. (2000). Self-explaining expository texts: The dual processes of generating inferences and repairing mental models. In R. Glaser (Ed.), Advances in Instructional Psychology, Hillsdale, NJ: Lawrence Erlbaum Associates. 161-238.

[3] Chi, M. T. H., Bassok, M., Lewis, M., Reimann, P., & Glaser, R. (1989). Self-explanations: How students study and use examples in learning to solve problems. Cognitive Science, 13: 145-182.

[4] Chi, M. T. H., de Leeuw, N., Chiu, M. H., & LaVancher, C. (1994). Eliciting self-explanations improves understanding. Cognitive Science, 18: 439-477.

[5] Booth, J. L., Lange, K. E., Koedinger, K. R., & Newton, K. J. (2013). Using example problems to improve student learning in algebra: Differentiating between correct and incorrect examples. Learning and Instruction, 25, 24-34.

[6] Hausmann, R.G.M., & Chi, M.T. H. (2002). Can a computer interface support self-explaining? Cognitive Technology, 7(1), 4-14.

[7] McNamara, D. S., Levinstein, I. B., & Boonthum, C. (2004). iSTART: Interactive strategy training for active reading and thinking. Behavior Research Methods, Instruments, & Computers, 36(2), 222-233.

[8] Jackson, G. T., & McNamara, D. S. (2013). Motivation and performance in a game-based intelligent tutoring system. Journal of Educational Psychology, 105(4), 1036.

Thursday, July 2, 2015

The Sandpaper Theory of Success: Grit

We all know the importance of IQ on academic success, but the problem is that it takes so long to measure. To get around that problem, psychometricians have boiled the traditional IQ test down to three questions. Take a few minutes and answer the World's Shortest IQ Test [1]:
  1. A bat and a ball cost $1.10 in total. The bat costs $1.00 more than the ball. How much does the ball cost? _____ cents
  2. If it takes 5 machines 5 minutes to make 5 widgets, how long would it take 100 machines to make 100 widgets? _____ minutes
  3. In a lake, there is a patch of lily pads. Every day, the patch doubles in size. If it takes 48 days for the patch to cover the entire lake, how long would it take for the patch to cover half of the lake? _____ days

The Right Stuff

The history of IQ testing is extremely interesting [2]. The purpose of testing someone's IQ is to predict how well that person will perform on some important (future) task. For instance, a Harvard admission officer would like to admit only the students who are most likely to graduate. The officer needs information today that will help her reliably place her bet. Moreover, she doesn't want to be fooled by any surface features that may seem to be related to graduation rate (e.g., the applicant's family name). In other words, the admission officer needs a measure today that will highly correlate with the outcome of graduation, which will most likely take place in four to five years. If she has 37,000 applications for only 2,000 slots, how will she choose? What information is the most reliable? 

High-profile colleges and universities turned to intelligence testing in an effort to become more egalitarian. The name and content of those intelligence tests may have changed over the years, but the intent behind them has always been the same: Find a scientifically valid measure that correlates with academic success. Once that has been established, then decision makers will have an easier time allocating their scarce resources (e.g., admission to Harvard).

While the goal may be clear, its implementation is far from it. First of all, there isn't universal agreement on what counts as "academic success." Is it merely graduating? Or does the student have to earn all "A's"? Does the student have to obtain a high-paying job straight out of school to be considered a success? Because of this ambiguity, there may be some behavioral measures that correlate better with certain definitions of success than others. So now what? Where does that leave IQ testing?  


"Get a hold of yourself!"  

For the sake of moving the conversation forward, let's assume that academic success is rigorously defined as the student's final GPA. The association between IQ and final GPA, unfortunately, is modest (r = .32). That means that only about 10% of the variance is explained by differences in IQ. Said a different way, 10% of the differences in the outcome measure (i.e., final GPA) can be explained by differences in IQ. A third way to think about it is if we consider all of the students with the exact same IQ; their final GPAs are going to be fairly different from each other. How might we explain the differences in GPA for kids who all have roughly the same IQ? 

Because IQ is an imperfect predictor, scientists decided to expand their search and consider various other factors. What other traits can we measure to predict success? Angela Duckworth and the collaborators in her lab decided to focus on two very important personality traits: grit and self-control [3]. Grit can be thought of as persistence in the face of adversity and self-control as the ability to delay gratification in the service of long-term goals. How well do grit and self-control stack up against IQ? 

According to one of their studies [4], the correlation between IQ and final GPA was r = .32, whereas the correlation between final GPA and their measure of self-control was r = .67. A perfect correlation (r = 1.00) means that you can predict the outcome of an event every single time. Thus, the measure of self-control was twice as good at predicting academic success as IQ. That's pretty interesting given our infatuation with "IQ."


The STEM Connection

Given that grit and self-control are more strongly associated with academic success than IQ, what does that mean for education? 

First, I think the time is ripe to banish the word "smart" from our vocabulary. Why? Because it does not motivate people toward higher levels of academic achievement. For example, suppose I told you that you are smart. Now what? Are you going to seek out challenging assignments that stretch you in a new direction? Or are you going to play it safe and only accept assignments that are within your comfort zone? That way you can continue to collect confirmatory evidence that you are smart. Alternatively, what if I labeled you as gritty. How might that affect your behavior? You might take pride in the fact that you tackled a highly challenging task, faced obstacles head on, and stuck it out until you experienced a breakthrough. Being called "gritty" moves you toward learning opportunities in a way that being labeled "smart" does not.

Second, these findings suggest that students should be given long-term assignments that are extremely difficult. In so doing, however, we should ensure that failure is an acceptable step along the way. For example, when I write a computer program, I am grateful when I fail quickly because then I can correct my mistakes and improve the overall quality of the program [5]. 

Finally, we should strongly consider adding character strengths as part of our standard curriculum. Like the growth mindset, these qualities are malleable and can be taught. Some charter schools go so far as to weave character development into the very fabric of their school [6]. When students see the implications of their behavior (i.e., by quitting or not) on their classmates, the lesson comes to life and is thereby encoded as an episodic memory. 

For each of us, grit and self-control appear in various quantities. They may fluctuate from time-to-time, and they may largely depend on the task at hand. But the main take-away from this nascent literature is that, while IQ is important for life-long success, there are other factors that strongly shape the course of one's life in school (and beyond).


Share and Enjoy!

Dr. Bob

For More Information

[1] Frederick, S. (2005). Cognitive reflection and decision making. Journal of Economic perspectives, 19(4) 25-42.

[2] Gould, S. J. (1996). The mismeasure of man (Rev. ed.). New York: W.l. Norton.

[3] Watch Angela Duckworth's TED talk.

[4] Duckworth, A. L. & Seligman, M. E. P. (2005). Self-discipline outdoes IQ predicting academic performance in adolescents. Psychological Science, 16, 939-944.

[5] Fail Fast has become a mantra in Silicon Valley. 

[6] Read about the KIPP Academy in Tough, P. (2013). How children succeed. Random House (cf. Chapter 2).

Thursday, June 25, 2015

The Downside of Expertise: Part 2

Editorial Note: This is the second installment of The Downside of Expertise. In Part 1, we introduced the idea that experts can get stuck in a rut. They have a hard time ignoring their expertise when it comes to things riding a bike, swinging at a pitch, or generating creative solutions to a problem. In Part 2, we explore how this line of research got started, and how it might connect to education. Go find your chessboard, and we'll get started! 

Check and Mate!

As it turns out, much of what we know about expertise began with studying those who play chess — a lot of chess. To simulate the methodology that the early studies used, let's start with two chessboards. For one of the boards, we've caught the players in the middle of a game. For the other board, the pieces are scattered randomly about the board. Can you tell which board is an actual game and which one is random [1]?


Chessboard A



Chessboard B

Now that we've determined which board is which, what if I asked you to memorize the configuration of the pieces on the board? Do you think you could do it? How long would you have to study the board until you memorized all of the pieces? How many pieces do you think you could get right after studying the board for one minute?

Let's up the ante one more time. Suppose that we pitted your board memorization skills against a chess master. Amazingly, a master can reproduce an entire chessboard in about 5 seconds [2]. In a controlled laboratory experiment, scientists compared asked a chess master, a class A player, and a chess novice to memorize a mid-game or randomly scattered board [3]. For a mid-game board, the chess master was able to remember more pieces than either the class A player or the novice. He was able to memorize the spatial configuration of approximately 25 pieces because he was able to chunk them into higher-level patterns of positions one might expect during a chess game. Given what we know about well-developed retrieval structures, the master's performance comes as no surprise. 

But how did the chess expert fair with the random board? As it turns out, his performance was reduced to a novice, despite the fact that he had an extremely elaborate schema for chess positions. Because the positions didn't make any sense in the random configuration, he was forced to fall back to brute-force memorization, which carries with it all of the standard limitations of working memory. In fact, the novice slightly outperformed him!

The same principle of expertise holds for chess masters and Major League Baseball batters: Expertise is highly narrow. Once you depart from the patterns that experts expect, they perform at novice levels.

The STEM Connection

There are definite downsides to expertise when the situation completely violates an expert's deeply engrained schema or mental model. But what, if any, are the downsides for education? A master teacher is an expert in a particular content area (e.g., how to solve algebraic problems) and owns a vast repertoire of pedagogical content knowledge (e.g., how to teach algebra). 

Like the creativity study, can content knowledge get in the way of teaching? One way that it might be harmful is when teachers forget what it is like not to know something. Or, stated differently, experts might not remember the developmental sequence that a student must undergo when learning something new. When this forgetting takes place, educational researchers call it the expert blindspot.

In a series of studies [4-6], Mitch Nathan and his collaborators demonstrated the conditions under which expert teachers are blinded by their expertise. They asked teachers with different levels of content knowledge to rank-order six math problems that varied along two dimensions. For the first dimension, the unknown (x) was placed either at the beginning (e.g., x • a + b = c) or the end (e.g., [c - b]/a = x) of the problem. The start-unknown problems were essentially algebraic problems because the student had to apply the inverse of the operators to compute the unknown value. The end-unknown problems were essentially arithmetic problems because they could be solved by applying each operator in the prescribed order. 

For the second dimension, problems were stated either symbolically (e.g., x • 6 + 66 = 81.90), as a word equation (e.g., "Starting with some number, if I multiply it by 6 and then add 66, I get 81.90. What did I start with?"), or as a story problem (e.g., "When Ted got home from his waiter job, he multiplied his hourly wage by the 6 hours he worked that day. Then he added the $66 he made in tips and found he earned $81.90. How much per hour did Ted make?"). Take a moment to figure out which problems you think are the most difficult:
  1. Start-unknown; story problem
  2. Start-unknown; word equation
  3. Start-unknown; symbolic equation
  4. End-unknown; story problem
  5. End-unknown; word equation
  6. End-unknown; symbolic equation
All teachers agreed that the end-unknown problems were easy because they basically tell the student what to do. The surprising result was that students found the verbal problems (i.e., the story problem and word equation) to be easier than the symbolic equation for the start-unknown problems. The reason why is that the format of these problems prompted students to fall back onto various problem-solving patterns that were logic-based. In other words, students have been reasoning verbally for much longer than they have symbolically, and this became evident when they were faced with challenging, algebraic problems. 

Expertise is typically a great thing to aspire to, and I highly recommend it. So I don't want to give the impression that you should avoid becoming an expert. But I do want to make explicit some of the misconceptions that people might have about what experts can and can't do. As the authors of Freakonomics are fond of saying, there's a "hidden side to everything" [7]. For expertise, the hidden side is a difficulty in suppressing one's own expertise.


Share and Enjoy!

Dr. Bob

For More Information

[1] Chessboard A is an actual mid-game; whereas Chessboard B is a random assortment of pieces. There are multiple ways to figure it out, but one piece of evidence is that there are two black bishops on the same colored squares, which can never happen in an actual game.

[2] de Groot, A. D. Thought and choice in chess. The Hague: Mouton, 1965. 

[3] Chase, W. G., & Simon, H. A. (1973). Perception in chess. Cognitive psychology, 4(1), 55-81.

[4] Nathan, M. J., & Koedinger, K. R. (2000). An investigation of teachers' beliefs of students' algebra development. Cognition and Instruction, 18(2), 209-237.

[5] Nathan, M. J., & Koedinger, K. R. (2000). Teachers' and researchers' beliefs about the development of algebraic reasoning. Journal for Research in Mathematics Education, 168-190.

[6] Nathan, M. J., & Petrosino, A. (2003). Expert blind spot among preservice teachers. American Educational Research Journal, 40(4), 905-928.

[7] Dubner, S. J., & Levitt, S. D. (2010). Freakonomics: A Rogue Economist Explores the Hidden Side of Everything. HarperCollins.

Thursday, June 18, 2015

The Downside of Expertise: Part 1

Editorial Note: I am so excited about the next topic that I had to split it across two posts. For Part 1, I introduce the idea that, while expertise is great, there is a cost associated with it. In Part 2, I will talk about the origin of research on expertise and its educational implications. Let's jump in with a real mind scrambler!

The Backwards Brain Bicycle 

Grab a junky bike and pull the handlebars and stem out of the steerer tube. Next, weld one gear onto the steerer tube and another gear onto the stem (the stem is the piece connected to the handlebars). Once you're done, it should look like this:





Due to your modification, when you turn the handlebars to the right, the front wheel pivots to the left (and vice versa). Before you embark on your maiden voyage, what do you suppose will happen? If you're not sure, take a look at this fascinating video.



What happened to this poor engineer? Why did it take him eight months to learn how to ride his "backwards brain bicycle"? The answer to that question is related to why a softball pitcher can reliably strike out the best batters from Major League Baseball (MLB).


"Swing and a miss" --Harry Doyle

In MLB, there is a distance of exactly 60.5 feet between the pitcher's mound and home plate. When a pitcher throws a 95 mph fastball, the ball arrives in a little less than half a second (.43 seconds, to be precise). That means the batter needs to decide whether he should swing (or not) in about a quarter of a second. Otherwise, the ball will blow past him as he stands there and ponders whether he should swing. 

Because it truly is a split-second decision, the batter must look for an edge. One place to find an edge is to move upwards in the stream of events and find a reliable cue for swinging. One of the cues that batters use is the pitcher's grip on the ball. If they hold it with two fingers over the top, then it is a fastball. If they put more distance between their forefinger and the thumb, then it will be a curve ball. The other cue that batters look for is the spin on the ball, which transmits itself as a certain "color" of pitch. 

MLB players log thousands of hours behind the plate trying to hone their batting ability. In effect, they become experts in watching, categorizing, and reacting to a variety of different pitches. So if they truly are expert batters, then why can softball pitcher Jennie Finch strike out batting legends Barry Bonds and Albert Pujols? [1]

The explanation is fairly simple. Expertise is highly narrow. When faced with a typical softball pitch, MLB batters are watching for something that will never come. They've essentially wired their brain to perceive and react (without much conscious intervention, mind you) to a highly narrow band of stimuli. Because overhand pitches used in MLB tend to fall, the batter watches for a ball that starts high and gets pulled to the ground. A softball pitcher throws underhand, so the ball starts low and has the possibility of rising. They also are watching for the aforementioned cues of the pitcher's grip and the spin on the ball, but the grip that a softball pitcher uses is completely different. By changing the narrow band of stimuli that a batter is trained to read, you can essentially reduce and expert batter to a novice, or possibly even worse.

But let's stop talking about muscular expertise. What about conceptual expertise? Are there any hidden costs there?


Looking in All the Wrong Places

Another way in which expertise can steer a person wrong is by biasing her to look for solutions within the prescribed content area of her specialty. Consider the following experiment [2] where baseball experts were given a creativity test called the Remote Associates Test (RAT). Their job was to look at a list of three words and figure out what single word binds them together. There were multiple experiments and conditions in the original study, but the one relevant to the current discussion was between lists of words where the domain knowledge was relevant and applicable and a different list of words where the domain knowledge was irrelevant and misleading. 

To make this concrete, suppose you are a baseball expert, and I give you the following three words: 

Baseball-Relevant:     WILD     DARK       FORK

What word connects these three? A baseball expert might answer PITCH (e.g., wild pitch, pitch dark, and pitch fork). The word "pitch" comes straight out of baseball, and it is therefore relevant to the solution to this RAT problem. When solving baseball-relevant problems, baseball experts had an accuracy rate of about 38%. This was roughly the same accuracy rate among baseball novices, who identified the connecting word 40% of the time.

But then the experimenters switched things up and gave baseball experts and novices a list of words that seemed like they might be connected to baseball, but ultimately they were not connected. Here is an example: 

Baseball-Irrelevant:     PLATE     BROKEN       SHOT 

What single word connects these three [3]? The first two words seem to hint at HOME (e.g., home plate and broken home), but then HOME doesn't really go with the last word (what is a home shot or a shot home?). How do you think the experts did? Their performance plummeted. Their accuracy rate dropped by over half, to 15%. Baseball novices didn't show the same drop in their performance; in fact, they showed the same accuracy rate of 40% on the baseball-relevant and irrelevant tasks. 

What's going on? Why can't baseball experts suppress their knowledge? Even when the experimenters warned them that baseball knowledge was irrelevant, they still couldn't turn it off. They seemed to be biased towards looking for solutions that are aligned with topics that they know a lot about, which actually interfered with performance when the solution was not aligned with their area of expertise. What may also be surprising is that the experts, at least for this task, did not out-perform their novice counterparts. In my next post I will explore situations in which being an expert can help, or hinder, performance, depending on the task at hand.


That concludes Part 1 of The Downside of Expertise. Check back next week for the conclusion and the connection to education!

Share and Enjoy!

Dr. Bob

For More Information

[1] Why MLB hitters can't hit Jennie Finch and science behind reaction time. Sports Illustrated, Volume 119, Issue 4. (July 29, 2014) [link] [video]

[2] Wiley, J. (1998). Expertise as mental set: The effects of domain knowledge in creative problem solving. Memory & Cognition, 26 (4) 716-730.

[3] The word that binds PLATE, BROKEN, SHOT together is GLASS.




Thursday, June 11, 2015

The Thin Red Line: Precise Elaboration

Below are two lists of sentences. The first list contains short sentences with the following structure: <definite article> <adjective> <subject> <verb> <article> <direct_object>. The second list contains long sentences with the same structure, plus an extra prepositional phrase (in italics) at the end that modifies the base sentence. 

After reading the sentences, suppose I were to give you a memory test. Which sentences do you think would be easier for you to remember? Why is that the case?


Short Sentences


  1. The short man bought the broom. 
  2. The old man used the paint.

  3. The fat man looked at the warning.

Long Sentences


  1. The short man bought the broom to operate the light switch.

  2. The old man used the paint to change the color of his cane.

  3. The fat man looked at the warning that said keep off the thin ice.

Many of the previous posts about memory talked about memorizing individual items, like numbers, letters, or words. While it is essential to be able to remember small bits of information, it is also important that we have the ability to remember longer, more complicated pieces of information. Reading often requires the ability to encode large blocks of complicated information. What kind of strategies exist to help boost our memory for sentences? 


Elaborative Processing

As stated previously, one strategy to boost your memory is to add supplemental information. It seems counter-intuitive that adding information would increase the likelihood of remembering because now you have more to remember! It works because the mind craves two things: order and redundancy.

To demonstrate, a pair of scientists constructed some cleverly-worded sentences and gave them to participants to read [1]. The first type of sentence, or base sentences, included two nouns connected by a verb. Here is an example: 
Base Sentence: The woman hit the butcher. 
For the second type of sentence, the scientists embellished the base sentences with some color commentary, like this:
Embellished Sentence: The woman hit the butcher with a sausage.
Half of the participants read the base sentences and the other half read the embellished sentences. After they studied the sentences, the experimenters then checked the accuracy of the participants' memory for the underlined words. You can probably guess the outcome of the experiment. If you guessed that the people who read the base sentences remembered fewer items (57%) than those who read the embellished sentences (72%), then you would be correct. The explanation was that the additional information helped create a rich context for remembering the other words in the sentence. The additional commentary helped glue everything together. 

"Doctor, isn’t that incision a bit high for an appendix?"

This is an interesting finding because it shows that our memories are sensitive to the information that surrounds the target information. However, the results left a couple of open questions. First, does the type of elaboration matter? By type I am referring to the relevance of the elaboration to the main sentence. An imprecise elaboration does not add relevant information. On the other hand, a precise elaboration adds information that is semantically connected to the base sentence. A precise elaboration, for example, might explain why being "thin" is relevant to the developing story. 

The second open question deals with the generation effect, which distinguishes between elaborations that are provided by someone else or that we generate ourselves. In the experiment described in the previous section on elaborative processing, the elaborations were provided by the experimenters. What if people were able to supply their own color commentary? Would that prove to enhance memory even more?

To test these questions, some other scientists wrote another set of cleverly-worded sentences that the they gave participants to study [2]. The sentences included the following four types:
  1. Base sentence: The thin man picked up the scissors.
  2. Imprecise-elaboration: The thin man picked up the scissors to cut the tag off his hat. 
  3. Precise-elaboration: The thin man picked up the scissors to cut the belt in half.
  4. Self-elaboration: The thin man picked up the scissors ______________.

There were two phases to the experiment. For the first phase, participants either read the sentences that they were given (base, imprecise-elaboration, or precise-elaboration sentences), or they read the base sentence and generated their own elaboration (self-elaboration). During the second phase of the experiment, participants were given the base sentence with the adjective removed (e.g., thin), and their job was to recall the missing word.

Before I describe the results, can you guess the order of the conditions in terms of their performance on the cued recall test?


Fig. 1: Results from the elaboration study.

As you can see from the graph, the individuals who read sentences that were imprecisely elaborated performed the worst. They recalled fewer adjectives than the participants in the other conditions of the experiment. The best performance was found in the group that read the precisely elaborated sentences, with the self-elaboration not too far behind. 

In summary, I guess it would be a mistake to say that merely adding additional information helps boost our memory. Instead, the additional information needs to be semantically relevant.


The STEM Connection

The research on elaboration has useful applications for education. First, textbooks should be written with the second study in mind. That is, textbook authors should strive to ensure that their elaborations are precisely worded and relevant to the material being presented. The goal is to create a coherent mental model for the reader. For example, it would be insufficient to say, "Hot air rises." because an explanatory mechanism is not mentioned. Instead, the reader is forced either to memorize this bit of information or supply their own explanation for why hot air rises. Self-generated elaborations aren't necessarily a bad thing (as we will see in a future post), but the reader might be lazy and neglect the intellectual work needed to understand the passage.

The second application is on the student side. Students should train themselves to supply their own explanatory or causal mechanism when it is missing. If a piece of text doesn't make sense or seems incomplete, the reader should ask, "Why does hot air rise?" This type of self-prompting is beneficial because the reader is effectively training herself to become more meta-cognitively aware.

The research behind elaborative processing and precisely worded elaborations is interesting because we've started to move past merely memorizing lists of words; however, we are still at the sentence level. The next goal is to figure out how we process larger chunks of texts – like entire paragraphs! 


Share and Enjoy!

Dr. Bob

For More Information

[1] Anderson, J. R., & Bower, G. H. (2014). Human associative memory. Psychology Press.

[2] Stein, B. S., & Bransford, J. D. (1979). Constraints on effective elaboration: Effects of precision and subject generation. Journal of Verbal Learning and Verbal Behavior, 18(6), 769-777.

Thursday, June 4, 2015

Doin' the Bull Dance. Feelin' the Flow: Flow

Grab your clubs and let's hit the links. You are lining up a putt. If you sink it, you will be two under par. All of the noises around you fade away. You don't even notice the people waiting for you in the golf cart. Time slips by, unnoticed. You draw in a breath, hold it, and swing. The ball meanders its way to the hole and drops in effortlessly.

If golf isn't your thing, then get roped in. I will be your belay. Get ready to scale the side of that boulder. You've been practicing rock climbing indoors, and now you are ready to put your skills to the test outdoors. You chalk up and move methodically up the face of the rock. Like the golfer, your attention is completely focused on the task at hand. You don't notice anybody or anything. All you care about is reaching the top. 

It is difficult to simulate exactly what it feels like to be "in the zone" because what works for each person is different. Some may experience it while programming a computer, whereas others might find it while painting. Even though the activities that get people in the zone are highly varied (e.g., sports vs. coding vs. art), there are many similarities in the experience itself. That experience is what many call Flow.


In the Zone

Why do we do what we do? Many of our daily activities are born out of duty or obligation. For example, we have to finish a presentation for our boss, or we have to buy groceries for the family. But some activities we do merely for the sake of doing them. In other words, the activity is so pleasurable that we do it for its own sake. These types of activities are the most conducive for getting into the zone, or what is also known as a flow state.

A flow state is facilitated and characterized by doing a task where:

  1. There is a high likelihood of success
  2. The environment is conducive to focus and concentration
  3. There is a clear set of goals
  4. There is immediate feedback
  5. The task is all encompassing (i.e., daily concerns fall to the side)
  6. The experience is enjoyable and done for its own sake
  7. There is a lack of self-awareness
  8. Time passes unnoticed

Some of the characteristics have to do with the sense of "self" while engaged in the activity. The concept of self is a little slippery, but we will define it as "thinking about yourself" — a meta-reflection of sorts. When engaged in flow, you stop thinking about yourself and any of the other thoughts and concerns that you have. Flow is probably enjoyable because you are focused on something other than your problems. 

It's also the case that you don't notice (or miss) the passage of time when you are in a state of flow. You start the activity, get in the zone, and then are shocked when you look at the clock and notice that a few hours felt like a couple of minutes. In addition to the passage of time, the surrounding environment, including things and people, fade into the background and aren't noticed. If external stimuli (e.g., time, self, others) aren't part of the task, then they fall outside the realm of attention and awareness. 

Finally, the other flow characteristics have to do with the task and the person. The goals are easily defined, as is the feedback. While rock climbing, you know if you've made a mistake (or are about to). The environment itself is set up so that you can completely focus.

How do I get into flow?

Because flow is a pleasurable experience, many of us spend at least some of our free time trying to get into the zone. But how can we maximize our chances of achieving flow? The answer to that question is best expressed in Csikszentmihalyi's (pronounced: CHEEK- sent-mÉ™-HY-ee) book, Flow [1]. In it, he includes this helpful illustration: 




The highest probability of finding flow is when there is a tight coupling between a person's skill (represented on the x-axis) and the difficulty or challenge of the task (represented on the y-axis). If the person has a high amount of skill, but engaged in a task that is not at all challenging, then she will be bored. Conversely, if the person has a low amount of skill, but takes on a task that is too challenging, then that person will experience anxiety and frustration. The balance between a person's skill level and the difficulty of the task creates a flow channel. The flow channel is dynamic in the sense that it changes as a person becomes more proficient. 


The STEM Connection

Although rare, some of the best educational experiences happen when a student is able to experience flow while learning. How, then, can we apply the eight characteristics of flow to the classroom? First, we need to engineer a setting where the student is not distracted by irrelevant stimuli (that's hard to do, I know). We should also design a set of educational activities where there is a high likelihood of success based on the student's level of skill. Perhaps we could allow the student to select the level of difficulty for herself. In so doing, the student is given a chance to test the calibration of her metacognitive skills. 

In addition, the educational activity should have a clear goal with immediate feedback. Computer tutors are a natural fit because many are designed with the principle of providing immediate feedback [2]. Finally, the flow channel indicates that a student's proficiency at a particular task is going to: a.) be initially different, and b.) change over time. An added challenge to educators is to create learning experiences that accommodate a diverse and dynamically changing student population. Again, a computerized tutoring system is an ideal candidate if it can estimate a given student's level of expertise and tailor the training accordingly [3].

It's my hope that every sphere of life —work, home, or school — presents opportunities for us to get in the zone (and stay there as long as possible).


Share and Enjoy!

Dr. Bob

For More Information

[1] Csikszentmihalyi, M. (1990). Flow: The Psychology of Optimal Experience. New York: HarperCollins Publishers.

[2] Corbett, A. T., & Anderson, J. R. (2001, March). Locus of feedback control in computer-based tutoring: Impact on learning rate, achievement and attitudes. In Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 245-252). ACM.

[3] Vanlehn, K. (2006). The behavior of tutoring systems. International Journal of Artificial Intelligence in Education, 16(3), 227-265.