Posted on January 11, 2024

The Misguided War on the SAT

David Leonhardt, New York Times, January 7, 2024

After the Covid pandemic made it difficult for high school students to take the SAT and ACT, dozens of selective colleges dropped their requirement that applicants do so. Colleges described the move as temporary, but nearly all have since stuck to a test-optional policy. It reflects a backlash against standardized tests that began long before the pandemic, and many people have hailed the change as a victory for equity in higher education.

Now, though, a growing number of experts and university administrators wonder whether the switch has been a mistake. Research has increasingly shown that standardized test scores contain real information, helping to predict college grades, chances of graduation and post-college success. Test scores are more reliable than high school grades, partly because of grade inflation in recent years.

Without test scores, admissions officers sometimes have a hard time distinguishing between applicants who are likely to do well at elite colleges and those who are likely to struggle. Researchers who have studied the issue say that test scores can be particularly helpful in identifying lower-income students and underrepresented minorities who will thrive. These students do not score as high on average as students from affluent communities or white and Asian students. But a solid score for a student from a less privileged background is often a sign of enormous potential.

“Standardized test scores are a much better predictor of academic success than high school grades,” Christina Paxson, the president of Brown University, recently wrote. Stuart Schmill — the dean of admissions at M.I.T., one of the few schools to have reinstated its test requirement — told me, “Just getting straight A’s is not enough information for us to know whether the students are going to succeed or not.”

An academic study released last summer by the group Opportunity Insights, covering the so-called Ivy Plus colleges (the eight in the Ivy League, along with Duke, M.I.T., Stanford and the University of Chicago), showed little relationship between high school grade point average and success in college. The researchers found a strong relationship between test scores and later success.

{snip}

“Test scores have vastly more predictive power than is commonly understood in the popular debate,” said John Friedman, an economics professor at Brown and one of the authors of the Ivy Plus admissions study.

{snip}

But the data suggests that testing critics have drawn the wrong battle lines. If test scores are used as one factor among others — and if colleges give applicants credit for having overcome adversity — the SAT and ACT can help create diverse classes of highly talented students. Restoring the tests might also help address a different frustration that many Americans have with the admissions process at elite universities: that it has become too opaque and unconnected to merit.

{snip}

Given the data, why haven’t colleges reinstated their test requirements?

{snip}

Many consider the tests to be unfair because there are score gaps by race and class. Average scores for modest-income, Black and Hispanic students are lower than those for white, Asian and upper-income students. The tests’ critics worry that reinstating test requirements will reduce diversity. The Supreme Court’s affirmative action decision has heightened these concerns.

If selective colleges made admissions decisions based solely on test scores, racial and economic diversity would indeed plummet. Yet almost nobody in higher education favors using tests as the main factor for admissions. The question instead is whether the scores should be one of the criteria used to identify qualified students from every demographic group.

{snip}

Today, perhaps the strongest argument in favor of the tests is that other parts of the admissions process have even larger racial and economic biases. Affluent students can participate in expensive activities, like music lessons and travel sports teams, that strengthen their applications. These same students often receive extensive editing on their essays from their well-educated parents. Many affluent students attend private schools where counselors polish each student’s application.

The tests are not entirely objective, of course. Well-off students can pay for test prep classes and can pay to take the tests multiple times. Yet the evidence suggests that these advantages cause a very small part of the gaps.

Consider that other measures of learning — like the NAEP, a test that elementary and middle school students take nationwide — show similarly large racial and economic gaps. The federal government describes the NAEP as “the nation’s report card,” while education researchers consider it a rigorous measure of K-12 learning. And even though students do not take NAEP test prep classes, its demographic gaps look remarkably similar to those of the ACT and SAT.

This similarity “is another piece of evidence that the SAT is picking up fundamentals,” said Raj Chetty, a Harvard economics professor who conducted the recent Ivy Plus study with Friedman and David Deming. “It strengthens the argument that the disparities in SAT scores are a symptom, not a cause, of inequality in the U.S.,” Chetty said.

{snip}

When I have asked university administrators whether they were aware of the research showing the value of test scores, they have generally said they were. But several told me, not for quotation, that they feared the political reaction on their campuses and in the media if they reinstated tests. “It’s not politically correct,” Charles Deacon, the longtime admissions dean at Georgetown University, which does require test scores, has told the journalist Jeffrey Selingo.

{snip}