Advantages and Drawbacks of Standardized Testing

Remember Good Will Hunting (1997), in which Matt Damon plays a math genius? The irony is that he plays the role of a self-taught math genius who keeps himself almost invisible behind the small-time job of a janitor at MIT.

The character of Will Hunting is a subtle reminder that there might be as many bright people outside conventional education as there are inside. Is there a similar case for standardized testing too? Is it possible that colleges might inadvertently reject some bright students who may not be skilled with such tests yet may be exceptional? Are there any alternatives to standardized tests?

In this post, we examine both sides of the coin: the advantages and shortcomings of standardized tests. We examine why many colleges find standardized testing effective and convenient. We also draw from the opinions of educators and tutors.

But first, a rapid overview of standardized tests.

Standardized tests: A quick overview

Besides academics, standardized tests are used in a variety of disciplines, ranging from music to military, among others. In many standardized tests, all students attempt the same test and the evaluation criteria to assess their responses are also identical. 

However, in adaptive tests, different students are asked different yet comparable questions. Such tests adapt to the student's abilities. Those students who perform above a certain benchmark in one section are asked more difficult questions in the next. The goal is to maintain objectivity and compare students’ competence more accurately.

Testing seems to have come—or is coming—a full circle. Until about the mid-19th century, when education was restricted to only a few people, open-ended, non-standardized tests were prevalent. As the number of people getting an education increased, most non-standardized assessments were replaced by standardized tests. That was important to democratize education, especially after the rapid growth fueled by the Industrial Revolution.

Paradoxically, higher standards of education are forcing educators to look beyond standardized tests. That’s because an increasing number of employers are looking for diverse and more sophisticated skills from their workforce. The sweeping changes in technology and commerce require the labor force to have heterogeneous capabilities, not all of which are covered by standardized testing.

Why colleges prefer standardized testing

In order to fully understand the pros and cons of standardized testing, it will help you understand why most colleges use the scores of standardized tests as an important criterion while making admissions offers.

Below are the three principal reasons:

1. Speed and scalability

Standardized tests like the SAT can be assessed very quickly. Moreover, they can be easily scaled up or down as the number of students changes without compromising the test or its results.

2. Reliability

Because the scores have been arrived at by using a neutral system, the scores are reliable. A score of 1500 is clearly better than a score of 1400, since both scores have been arrived at using the same system.

3. Comparability

The scores are comparable because all students have been attempting nearly identical questions under identical test conditions in that comparing score range. This prevents any bias in making comparisons.

Why the debate on standardized testing

While using standardized test scores for admissions has distinct merits, there is some rationale for questioning its use as well.

Here’s something to start with. Forbes reported on a research study that found that standardized testing might actually favor students with a stronger background—something the study called social capital. 

Consider two students Luke and Jiah, who took the SAT two months back. Luke scored 1450 while Jiah scored 1170. On the face of it, Luke has performed better than Jiah. 

But once you learn about their backgrounds, a different picture emerges. Luke went to an expensive private school and could afford test prep courses. Jiah's family was barely making ends meet, and her school was not much. Even when she struggled with math, she had no one to turn to. From failing most of her math tests in school to getting 540 on the SAT math, she has come a long way.

The problem with using standardized test scores to accept—or reject—students is that the system fails to consider such differences. The skills and competence of all the students are measured using the exact same yardstick devised decades back. Such an approach fails to take into consideration the rapidly evolving world of today.

The limitations of standardized tests

Below are the downsides of using standardized tests:

• Works against some students: Some students are quite talented and skilled, but they come from disadvantaged backgrounds.  An Australian study, cited by Issues in Educational Research (IIER), mentioned a phenomenon called “zip code effect”: students’ scores correlated with the socio-economic characteristics of where they lived. In other words, students from weaker backgrounds started with a substantial disadvantage.
• Limits to certain learning styles only: Because such tests follow a fixed pattern of questions, they do not suit all styles of teaching and learning. For instance, some students may be great at applying theoretical concepts to practical situations. One potential drawback of standardized tests is that they don’t gauge a student’s socio-emotional intelligence.
• Restricts performance to a few hours: A single test, spread over 3 or 5 hours, cannot accurately measure a student’s abilities or potential of how they’d fare in the professional world. Such tests provide only a partial view of a student’s capabilities. A low score, therefore, can significantly lower a student’s faith in themselves, as studies like this one suggest.
• Ignores student’s overall growth: Such tests evaluate students in absence of any data on where the student was, say, a year back, and where the student is right now. As Megan Padden of OWL Education Services told us, “The states to assess a student accurately need to have a portfolio. … And that should not just be filling in bubbles because sometimes they just don't care.” 
• Offers a narrow view: Many students attempt such tests more than once and often improve their scores. What’s important to note is that they may have probably improved their test-taking abilities. They have not improved any real-life skills that will help them in their careers. Hence, an improved score may misguide colleges into believing the student has improved.
• Carries limited context: Any score that a standardized test report is based on questions designed with a certain context. Hence, the scores are valid only for that particular context and not others. For instance, the Analytical Writing part that you see in the GRE is unable to tell you if the student is as persuasive in public speaking.

The positive side of standardized tests

Sure, standardized tests aren’t the perfect tool to get the measure of a test taker’s potential. But that doesn’t mean such tests aren’t practical. They have been used for years, and they have their own merits. 

Here are the main strengths of standardized tests:

• Brings uniformity across regions: Tests like the GMAT, GRE, and SAT are conducted and evaluated at a national level. A large number of international students write these tests. This gives a larger picture of comparison on a uniform platform, which is both important and useful for college admissions committees. In the absence of such tests, they’d have to rely on the results of regional tests, which are often inconsistent with one another.
• Remains objective: In recent times, we have seen what The Telegraph called grade inflation. This refers to an overwhelming proportion of students getting A’s, thus making it difficult to reliably compare their caliber or preparations. A standardized test, conducted across the nation, can provide an objective comparison of performances. This helps the admissions committee minimize bias.
• Summarizes performance in a simple way: The scores of such tests act as a single point of truth. At the end of the day, parents, students, and admission officers need a brief statement that encapsulates a student’s performance. More importantly, the statement shouldn’t be difficult to interpret, or else it could lead to bias in judgment. The score cards of standardized tests like the GMAT give you just that: numbers that display how the student has fared. 
• Makes it easy for the admission officers: Admission committees get a clear picture of a student’s performance in areas that are defined in advance. For instance, the scores of the SAT math section easily shows the extent to which a student is comfortable with highschool algebra, arithmetic, and geometry. These are prerequisites for a big number of undergraduate courses. Hence, the college knows whether the student they’re accepting is already capable of taking the course or whether they will need some extra help.
• Encourages competition: Standardized tests motivate students to raise their benchmarks. Sam Belows told us in one of our podcasts that “it is important to have this kind of a competition because this is what pushes everybody to raise their standards…”. 
• Supports big volumes: Scoring, when carried out for multiple choice questions, can be scored really fast, without losing accuracy. Irrespective of the number of students, a standardized test will always be  In contrast, evaluation of non-standardized tests take more time, can become inaccurate or biased as the volume grows, and may even miss the purpose of testing. 
• Offers better representation: There is some evidence that standardized tests actually ‘benefits under-represented students’. A University of California report, as quoted in EdSource suggests that doing away with admission requirements could stop as many as 40 percent of African American students from entering the university. 

What can replace standardized testing

After analyzing the pros and cons of standardized tests, we have come to believe that such tests have a very important role to play, whether it’s college admissions or hiring. Hence, replacing standardized testing entirely would be like throwing away the baby with the bathwater.

Introducing new segments or formats in tests needs to be done with caution. Otherwise, the newer versions will bring in new limitations or deepen the current weaknesses. 

As an example, let’s say colleges decide to replace a writing section with videos. The college can permit students to record their own videos and send it to the college, and make essay writing optional or redundant. It sounds great because it’s a creative challenge. However, a new set of video consultants will crop up to guide and assist students. Again, the purpose behind the video exercise will be diluted.

Descriptive tests or practical evaluations for, say, engineering skills, may have the constraint of time or uniformity of evaluation. Some other forms of evaluations, like a live, in-person interview, have challenges like scaling. 

One option that seems viable is that of giving options to the student. If a college requires a student to submit ten items, there could be a bunch of fifteen items out of which the student chooses which ten to select. As an example, some students might choose an essay over a video, or some might choose a descriptive test over an objective test.

Of course, these are only early observations; more refined activities will emerge as we begin to prepare ourselves to change. But the whole point is that it’s a good time to begin discussing what can complement  standardized tests. Inputs and participation from all stakeholders will help us discover a system that’s superior to the one we currently use.  

‍(Many of the ideas in this article are based on the conversations during our podcasts, in particular with the ones with Sam Belows, Megan Padden, Michelle McAnaney, and Christine Lawlor King.)