Jack Schneider, an assistant professor of education at the College of the Holy Cross in Worchester, Mass., (and a former high school teacher and edweek.org blogger) had long studied research around school quality. When he was ready to send his own child to class in Somerville, Mass., and discovered the district鈥檚 low rating in an online tool created by The Boston Globe, he called out what he believed was a narrow methodology. How could you classify schools as good or bad based on SAT scores and teacher-student ratios alone? The creator of the tool responded: Think you can do better? Schneider accepted the challenge.
For decades, testing outcomes have been a significant factor in the evaluation of a school鈥檚 success. That results, as Schneider wrote in a 2013 Education Week Commentary, in a small number of winners and a large number of losers, and has led to poor reputations for many schools. Such stark divisions increase economic segregation, he said, as schools with strong scores push up property values, price out the working class, and leave low-income children isolated. While the Every Student Succeeds Act requires states to incorporate nontraditional indicators into their accountability systems in an effort to rethink school success, Schneider is urging a shift in mindset at every level of education.
In his new book, Beyond Test Scores: A Better Way to Measure School Quality, released in August by Harvard University Press, Schneider argues that more comprehensive data can undo harmful accountability systems, help parents and teachers make better decisions for students, and help school leaders more accurately recognize which schools need the most assistance鈥攁ll of which will improve the way we educate students. Schneider has seen improvements on the ground after creating a school quality framework for his own district that uses multiple measures of student engagement, achievement, and school culture.
The Massachusetts Consortium for Innovative Education Assessment, which Schneider co-founded in 2016, is now working at redefining accountability on a larger scale鈥攊n six school districts in his home state and counting.
Commentary Associate Kate Stoltzfus spoke to Schneider recently by phone about how other districts can find expansive ways to define success, thereby creating classrooms that put students鈥攏ot test scores鈥攆irst.
Standardized-test scores have been used to measure K-12 public schools鈥� quality for more than a half century, but accountability as measured by testing has grown increasingly important in recent decades. Why do you think this testing mindset has become so ingrained in U.S. schools?
The numbers produced by standardized tests fit the kind of seemingly objective, quantifiable metrics that have triumphed across American society. By now, many generations of people have come of age with testing simply being a part of life. ESSA and NCLB are merely the latest of these kinds of policy structures. You can go back to the middle of the 20th century and find policymakers describing how dependent they are on test scores for some kind of information about what is going on in local schools. The argument traditionally made for the past 15 years against standardized-test scores is that they are inaccurate and end up being harmful, but there鈥檚 something missing from that: We have a better way to do this.
After finding out that your child鈥檚 school district was ranked only by SAT scores and student-teacher ratios, you set out to create a new set of tools for measuring school quality. Three years into this work, what changes have you seen at the classroom and district levels?
Educators tend to trust data more when they see that those data align with all the things they are trying to do in the classroom."
We engaged stakeholders in the community in six districts [across Massachusetts]. We talked to students, families, teachers, principals, district administrators鈥攕everal hundred of them, in fact, to find out what it is they value and what they think good schools do. And then we organized all this into a school quality framework with five major categories: teachers and the teaching environment; school culture; resources; academic learning; and citizenship and well-being. We鈥檝e found that public perceptions of the public school actually improved when people had a wide array of performance data rather than just standardized-test scores, which tend to correlate strongly with family income. We鈥檝e also found that educators tend to trust data more when they see that those data align with all the things they are trying to do in the classroom.
How can more expansive ways of measuring schools be helpful to educators specifically?
They won鈥檛 be put in this position where they are being asked to do a job that is different from the job they believe in. Even just to shift from standardized testing to performance assessment (a broader and more comprehensive way of measuring student learning), what we see is teachers feel more empowered. They feel like they have a bit more autonomy to act as professionals.
Some of the data we鈥檙e producing are enabling teachers to do some experiments in their classroom, where they want to figure out how to engage students better, how to build stronger relationships with students and [greater] trust in the classroom. These are ultimately the kinds of data points that improve instruction and give educators information they didn鈥檛 already have, as opposed to standardized-test reports that will tell educators students are performing below a level of proficiency. An educator who spent 180 days in the classroom with that child probably knew that already.
It鈥檚 both about the spirit of a school and helping to restore the full purpose of education, and it鈥檚 about actionable information. For students and parents and citizens who are interested in public education, it鈥檚 about getting better at all of the things that we want to get better at, not just in this one narrow area鈥攖he acquisition of the academic content in math and English鈥攖hat often produces unintended consequences like undermining the rest of the curriculum.
You argue that testing results are often more indicative of students鈥� socioeconomic status than a school鈥檚 quality, and that a testing culture creates stigmas harmful to student success鈥攑articularly for low-income students. How so?
69传媒 who start with all kinds of early advantages鈥攏ot just material advantages, but the academic advantage of having two parents who are college-educated and are emphasizing education in the household and setting a tone and example鈥攖hose carry into school. And students who have those parents will do better on standardized tests than their peers who don鈥檛 grow up in such households. When we look at proficiency scores, we are often seeing the effect not of the school, but of the household on that individual child. Quality-conscious parents with the resources to move, to choose a 鈥済ood鈥� school or school district, begin to move to particular districts and choose particular schools and bring with them their high-scoring students. And the opposite is true when the school is branded as low-performing. One way to break this cycle is to begin to measure things that do not align so closely with demographic variables.
You say that you want to create better ways to measure schools, not just to better evaluate them individually, but to rethink as a nation how we conceptualize what a 鈥済ood鈥� school is. How has your definition of a good school been altered?
Most of us in our hearts know what a good school is and does, but we don鈥檛 have the language ready and we haven鈥檛 conceptualized it as a broader community. The way I tend to think about school quality these days is shaped by the future. Who are the kids I want to meet 10 years from now? That is not a world that is going to be made by drill-and-kill instruction in math and English. It鈥檚 a world that is going to be shaped by children discovering their interests and passions and talents in the classroom. It鈥檚 shaped by children going to school with people who are not always exactly like them and learning how to work together and who are given opportunities to play and create together. We are limited right now by our policies, tools, and language, but those things can change. We are not limited by our vision or by our shared sense of community.
The interview has been edited for length and clarity.
