Steven Dubner - Freakonomics
The unlikeliness of Harris’s bombshell—she was a grandmother, no less, without PhD or academic affiliation—prompted both wonder and chagrin. “The public may be forgiven for saying, ‘Here we go again,’” wrote one reviewer. “One year we’re told bonding is the key, the next that it’s birth order. Wait, what really matters is stimulation. The first five years of life are the most important; no, the first three years; no, it’s all over by the first year. Forget that: It’s all genetics!”
But Harris’s theory was duly endorsed by a slate of heavyweights. Among them was Steven Pinker, the cognitive psychologist and bestselling author, who in his own book Blank Slate called Harris’s views “mind-boggling” (in a good way).
“Patients in traditional forms of psychotherapy while away their fifty minutes reliving childhood con-flicts and learning to blame their unhappiness on how their parents treated them,” Pinker wrote. “Many biographies scavenge through the subject’s childhood for the roots of the grown-up’s tragedies and triumphs.
‘Parenting experts’ make women feel like ogres if they slip out of the house to work or skip a reading of Goodnight Moon. All these deeply held beliefs will have to be rethought.”
Or will they? Parents must matter, you tell yourself. Besides, even if peers exert so much influence on a child, isn’t it the parents who essentially choose a child’s peers? Isn’t that why parents agonize over the right neighborhood, the right school, the right circle of friends?
Still, the question of how much parents matter is a good one. It is also terribly complicated. In determining a parent’s influence, which dimension of the child are we measuring: his personality? his school grades? his moral behavior? his creative abilities? his salary as an adult? And what weight should we assign each of the many inputs that affect a child’s outcome: genes, family environment, socioeconomic level, schooling, discrimination, luck, illness, and so on?
For the sake of argument, let’s consider the story of two boys, one white and one black.
The white boy is raised in a Chicago suburb by parents who read widely and involve themselves in school reform. His father, who has a decent manufacturing job, often takes the boy on nature hikes. His mother is a housewife who will eventually go back to college and earn a bachelor’s degree in education. The boy is happy and performs very well in school. His teachers think he may be a bona fide math genius. His parents encourage him and are terribly proud when he skips a grade. He has an adoring younger brother who is also very bright. The family even holds literary salons in their home.
The black boy is born in Daytona Beach, Florida, and his mother abandons him at the age of two. His father has a good job in sales but is a heavy drinker. He often beats the little boy with the metal end of a garden hose. One night when the boy is eleven, he is decorating a tabletop Christmas tree—the first one he has ever had—when his father starts beating up a lady friend in the kitchen. He hits her so hard that some teeth fly out of her mouth and land at the base of the boy’s Christmas tree, but the boy knows better than to speak up. At school he makes no effort whatsoever. Before long he is selling drugs, mugging suburbanites, carrying a gun. He makes sure to be asleep by the time his father come home from drinking, and to be out of the house before his father awakes. The father eventually goes to jail for sexual assault. By the age of twelve, the boy is essentially fending for himself.
You don’t have to believe in obsessive parenting to think that the second boy doesn’t stand a chance and that the first boy has it made. What are the odds that the second boy, with the added handicap of racial discrimination, will turn out to lead a productive life? What are the odds that the first boy, so deftly primed for success, will somehow fail? And how much of his fate should each boy attribute to his parents?
One could theorize forever about what makes the perfect parent. For two reasons, the authors of this book will not do so. The first is that neither of us professes to be a parenting expert (although between us we do have six children under the age of five). The second is that we are less persuaded by parenting theory than by what the data have to say.
Certain facets of a child’s outcome—personality, for instance, or creativity—are not easily measured by data. But school performance is. And since most parents would agree that education lies at the core of a child’s formation, it would make sense to begin by examining a telling set of school data.
These data concern school choice, an issue that most people feel strongly about in one direction or another. True believers of school choice argue that their tax dollars buy them the right to send their children to the best school possible.
Critics worry that school choice will leave behind the worst students in the worst schools. Still, just about every parent seems to believe that her child will thrive if only he can attend the right school, the one with an appropriate blend of academics, extracurriculars, friendliness, and safety.
School choice came early to the Chicago Public School system. That’s because the CPS, like most urban school districts, had a disproportionate number of minority students. Despite the U.S. Supreme Court’s 1954 ruling in Brown v. Board of Education of Topeka, which dictated that schools be desegregated, many black CPS students continued to attend schools that were nearly all-black. So in 1980
the U.S. Department of Justice and the Chicago Board of Education teamed up to try to better integrate the city’s schools. It was decreed that incoming freshmen could apply to virtually any high school in the district.
Aside from its longevity, there are several reasons the CPS school-choice program is a good one to study. It offers a huge data set—Chicago has the third-largest school system in the country, after New York and Los Angeles—as well as an enormous amount of choice (more than sixty high schools) and flexibility.
Its take-up rates are accordingly very high, with roughly half of the CPS students opting out of their neighborhood school. But the most serendipitous aspect of the CPS program—for the sake of a study, at least—is how the school-choice game was played.
As might be expected, throwing open the doors of any school to every freshman in Chicago threatened to create bedlam. The schools with good test scores and high graduation rates would be rabidly oversubscribed, making it impossible to satisfy every student’s request.
In the interest of fairness, the CPS resorted to a lottery. For a researcher, this is a remarkable boon. A behavioral scientist could hardly design a better experiment in his laboratory. Just as the scientist might randomly assign one mouse to a treatment group and another to a control group, the Chicago school board effectively did the same. Imagine two students, statistically identical, each of whom wants to attend a new, better school. Thanks to how the ball bounces in the hopper, one goes to the new school and the other stays behind. Now imagine multiplying those students by the thousands. The result is a natural experiment on a grand scale. This was hardly the goal in the mind of the Chicago school officials who conceived the lottery. But when viewed in this way, the lottery offers a wonderful means of measuring just how much school choice—or, really, a better school—truly matters.
So what do the data reveal?
The answer will not be heartening to obsessive parents: in this case, school choice barely mattered at all. It is true that the Chicago students who entered the school-choice lottery were more likely to graduate than the students who didn’t—which seems to suggest that school choice does make a difference. But that’s an illusion. The proof is in this comparison: the students who won the lottery and went to a “better” school did no better than equivalent students who lost the lottery and were left behind. That is, a student who opted out of his neighborhood school was more likely to graduate whether or not he actually won the opportunity to go to a new school. What appears to be an advantage gained by going to a new school isn’t connected to the new school at all. What this means is that the students—and parents—who choose to opt out tend to be smarter and more academically motivated to begin with. But statistically, they gained no academic benefit by changing schools.
And is it true that the students left behind in neighborhood schools suffered? No: they continued to test at about the same levels as before the supposed brain drain.
There was, however, one group of students in Chicago who did see a dramatic change: those who entered a technical school or career academy. These students performed substantially better than they did in their old academic settings and graduated at a much higher rate than their past performance would have predicted. So the CPS school-choice program did help prepare a small segment of otherwise struggling students for solid careers by giving them practical skills.
But it doesn’t appear that it made anyone much smarter.
Could it really be that school choice doesn’t much matter? No self-respecting parent, obsessive or otherwise, is ready to believe that. But wait: maybe it’s because the CPS study measures high-school students; maybe by then the die has already been cast. “There are too many students who arrive at high school not prepared to do high school work,” Richard P. Mills, the education commissioner of New York State, noted recently, “too many students who arrive at high school reading, writing, and doing math at the elementary level. We have to correct the problem in the earlier grades.”
Indeed, academic studies have substantiated Mills’s anxiety. In examining the income gap between black and white adults—it is well established that blacks earn significantly less—scholars have found that the gap is virtually eradicated if the blacks’ lower eighth-grade test scores are taken into account. In other words, the black-white income gap is largely a product of a black-white education gap that could have been observed many years earlier. “Reducing the black-white test score gap,” wrote the authors of one study, “would do more to promote racial equality than any other strategy that commands broad political support.”
So where does that black-white test gap come from? Many theories have been put forth over the years: poverty, genetic makeup, the “summer setback”
phenomenon (blacks are thought to lose more ground than whites when school is out of session), racial bias in testing or in teachers’ perceptions, and a black backlash against “acting white.”
In a paper called “The Economics of ‘Acting White,’” the young black Harvard economist Roland G. Fryer Jr. argues that some black students “have tremendous disincentives to invest in particular behaviors (i.e., education, ballet, etc.) due to the fact that they may be deemed a person who is trying to act like a white person (a.k.a. ‘selling-out’). Such a label, in some neighborhoods, can carry penalties that range from being deemed a social outcast, to being beaten or killed.” Fryer cites the recollections of a young Kareem Abdul-Jabbar, known then as Lew Alcindor, who had just entered the fourth grade in a new school and discovered that he was a better reader than even the seventh graders: “When the kids found this out, I became a target…. It was my first time away from home, my first experience in an all-black situation, and I found myself being punished for everything I’d ever been taught was right. I got all A’s and was hated for it; I spoke correctly and was called a punk. I had to learn a new language simply to be able to deal with the threats. I had good manners and was a good little boy and paid for it with my hide.”
Fryer is also one of the authors of “Understanding the Black-White Test Score Gap in the First Two Years of School.” This paper takes advantage of a new trove of government data that helps reliably address the black-white gap. Perhaps more interestingly, the data do a nice job of answering the question that every parent—black, white, and otherwise—wants to ask: what are the factors that do and do not affect a child’s performance in school?
In the late 1990s, the U.S. Department of Education undertook a monumental project called the Early Childhood Longitudinal Study. The ECLS sought to measure the academic progress of more than twenty thousand children from kindergarten through the fifth grade. The subjects were chosen from across the country to represent an accurate cross section of American schoolchildren.
The ECLS measured the students’ academic performance and gathered typical survey information about each child: his race, gender, family structure, socioeconomic status, the level of his parents’ education, and so on. But the study went well beyond these basics. It also included interviews with the students’
parents (and teachers and school administrators), posing a long list of questions more intimate than those in the typical government interview: whether the parents spanked their children, and how often; whether they took them to libraries or museums; how much television the children watched.
The result is an incredibly rich set of data—which, if the right questions are asked of it, tells some surprising stories.
How can this type of data be made to tell a reliable story? By subjecting it to the economist’s favorite trick: regression analysis. No, regression analysis is not some forgotten form of psychiatric treatment. It is a powerful—if limited—tool that uses statistical techniques to identify otherwise elusive correlations.
Correlation is nothing more than a statistical term that indicates whether two variables move together. It tends to be cold outside when it snows; those two factors are positively correlated. Sunshine and rain, meanwhile, are negatively correlated. Easy enough—as long as there are only a couple of variables. But with a couple of hundred variables, things get harder. Regression analysis is the tool that enables an economist to sort out these huge piles of data. It does so by artificially holding constant every variable except the two he wishes to focus on, and then showing how those two co-vary.
In a perfect world, an economist could run a controlled experiment just like a physicist or a biologist does: setting up two samples, randomly manipulating one of them, and measuring the effect. But an economist rarely has the luxury of such pure experimentation. (That’s why the school-choice lottery in Chicago was such a happy accident.) What an economist typically has is a data set with a great many variables, none of them randomly generated, some related and others not.
From this jumble, he must determine which factors are correlated and which are not.
In the case of the ECLS data, it might help to think of regression analysis as performing the following task: converting each of those twenty thousand schoolchildren into a sort of circuit board with an identical number of switches.
Each switch represents a single category of the child’s data: his first-grade math score, his third-grade math score, his first-grade reading score, his third-grade reading score, his mother’s education level, his father’s income, the number of books in his home, the relative affluence of his neighborhood, and so on.
