69ý

Federal

Global Study Tracks Common Paths to Improving Schooling

By Stephen Sawchuk — December 07, 2010 7 min read
  • Save to favorites
  • Print
Email Copy URL

Around the world, school systems whose students have posted gains over time on international exams also appear to have embraced common clusters of interventions at particular phases of their improvement, concludes released last week by a prominent international consulting firm.

Such commonalities appear to transcend differences in nationality, size, demographics, and school spending, according to the analysis, which has drawn praise and skepticism from academics who study international comparisons.

Drawing from an analysis of nearly 600 reform strategies instituted across 20 international school systems over a quarter-century, the report by the London-based McKinsey & Co. suggests that school systems seeking to improve could do well by taking cues from the strategies used by those with similar performance trends—rather than trying to appropriate wholesale the techniques of the highest-performing countries.

Success Trajectories

Researchers from McKinsey & Co. evaluated 20 schooling systems around the world as they moved along a continuum of improvement from “poor” to “fair” to “good” and “great.”

BRIC ARCHIVE

SOURCE: “How the World’s Most Improved Systems Keep Getting Better”

It also takes a new tack on many current debates in education, eschewing the question of whether curriculum should be centralized or decentralized or whether teacher accountability should be formal or informal. Instead, the report indicates that all those strategies may be valid when deployed at the appropriate time on a system’s improvement trajectory.

Teachers’ Latitude

In general, the report finds that lower-performing school systems with weaker teaching forces, such as the education system now serving the Madhya Pradesh province of India, tend to provide teachers with prescriptive curricula and pedagogical techniques to ease the delivery of lessons and ensure consistency across classrooms and access for all students to achieve basic literacy and numeracy.

But systems that have mastered the basics and are striving for higher levels, like the Long Beach, Calif., district in the late 2000s, gradually give teachers and local schools more say over pedagogy and curriculum, transforming a tight central role into that of a supporting player that encourages local school personnel to use creativity and innovation to get students to reach ever higher.

The report also finds that growth in school systems can occur regardless of their starting point: Both the lowest- and highest-performing systems studied made improvements and narrowed gaps between students from different socioeconomic backgrounds, sometimes in as few as six years.

“It’s not the case that we have to wait 10, 15 years in order to see something happen in a school system,” said Mona Mourshed, a partner at McKinsey, during a Web presentation on the report. “It’s also not the case that rising performance means forsaking the achievement gap. Both of these are possible simultaneously.”

Common Interventions

The McKinsey report comes as the idea of “international benchmarking” education standards in the United States with those in other countries gains prominence. To an expanding base of literature on that topic, the McKinsey report indicates that the success of education interventions depends on when they are deployed, how they are adapted to fit the context of local circumstances, and how leaders go about gaining support for the initiatives.

For the report, McKinsey analysts examined gains on national and international exams since 1980 and identified two groups for study. The first consists of “sustained improvers” with five or more years of academic data points showing improvement, and the second of “promising starts”—developing countries with fewer years of improvement data.

From those groups, the authors selected 20 school systems—some encompassing an entire nation, others states or provinces—to study in depth. The list includes three systems in the United States: Boston; Long Beach, Calif.; and the Aspire Public 69ý charter network, in California.

Each system’s results on various international and national assessments, between 1995 and 2007, were translated onto a common scale. They were used to categorize systems’ performance trends in four stages: “poor to fair,” “fair to good,” “good to great,” and “great to excellent.”

Finally, the analysis catalogued a total of 575 interventions instituted in the 20 school systems during the period of their improvement and conducted field interviews with their leaders.

The researchers found that interventions fell in six different areas: revising curriculum and standards; establishing an appropriate reward and compensation structure for educators; building educators’ technical skills; assessing students; establishing data systems; and implementing laws and policies supporting the interventions. But the way those interventions manifested themselves at each performance stage differed.

For instance, systems that were poor-to-fair tended to rely on incentive funding for teachers and schools for meeting high performance targets. Those systems in the midlevel ranges had teacher salaries at a level comparable to gross domestic product per capita, while those in the great-to-excellent range tended to have salaries that far outpaced GDP per capita.

Similarly, lower-performing countries tended to use many more interventions based in accountability, like standardized student assessments, but systems in the good-to-great performance category and beyond, even those that had previously had formal accountability systems, reduced their frequency. And teacher evaluations gradually became less standardized as the teaching force got better and as teachers held one another accountable, through collaboration and demonstrations, for helping students to learn.

The report notes that context of the school system helps to shape the successful implementation of improvement strategies.

All the school systems studied share a focus on achievement data, for instance. But whereas the U.S. school systems and those in the United Kingdom and Canada have tended to make performance targets public, Asian and Eastern European countries tend to share data privately with schools for improvement.

The analysis also indicates that stable leadership appears to be a factor in all the improvements. Among the countries studied, education leaders oversaw reforms for an average of six years, at least two years longer than the average U.S. superintendent’s tenure.

Scale Concerns

Academics who have written about international benchmarking raised some questions about the universal-scale methodology used in the report. Created by Stanford University economist Eric A. Hanushek, the methodology has been used for other, less-extensive analyses of performance.

“I respect what they try to do in the study and I think it is certainly a move in the right direction as opposed to just saying [to education leaders], ‘Be like Finland; be like Singapore,’ ” said William H. Schmidt, a professor of statistics and education at Michigan State University, in East Lansing, who has compared content standards across countries. “But combining different subject matters across different tests and time points just poses enormous psychometric problems.”

Tony Wagner, an Innovation Education Fellow at the Technology and Entrepreneurship Center at Harvard University, raised questions about the different content of the exams on which the performance-trend data points were selected.

For instance, PISA consists mainly of open-ended questions designed to measure critical thinking, while the Trends in International Mathematics and Science Study, better known as TIMSS, is based heavily on multiple-choice questions that measure factual recall.

“When you dig deeper to figure out what’s being measured and how students are being motivated to succeed, there’s a difference of night and day in these systems,” said Mr. Wagner, who has written extensively about international comparisons.

McKinsey officials, however, said the universal-scale methodology used a control group of “mature and stable” systems to ensure accuracy.

The report’s implications for the United States are hard to tease out, given the country’s size, scope, generally decentralized nature, and disparities in income and population from district to district. Its more than 14,000 districts likely fall all along the report’s improvement continuum.

In the meantime, the nine-year-old No Child Left Behind Act, which requires states and districts to administer tests in grades 3-8 and once in high school, and intervene in low-performing schools, has been awaiting a rewrite since 2007. Proponents say that law has increased pressure to pay attention to neglected groups, but critics contend it has led to a focus on basic skills.

The authors plan to host an event to discuss what the report means for U.S. schooling on Dec. 7, the same day results from PISA are due.

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Artificial Intelligence Webinar
AI and Educational Leadership: Driving Innovation and Equity
Discover how to leverage AI to transform teaching, leadership, and administration. Network with experts and learn practical strategies.
Content provided by 
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School Climate & Safety Webinar
Investing in Success: Leading a Culture of Safety and Support
Content provided by 
Assessment K-12 Essentials Forum Making Competency-Based Learning a Reality
Join this free virtual event to hear from educators and experts working to implement competency-based education.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.

Read Next

Federal Opinion What's Really at Stake for Education in This Election?
What a Harris or Trump presidential victory might mean for federal education policy, according to Rick Hess.
5 min read
The United States Capitol building as a bookcase filled with red, white, and blue policy books in a Washington DC landscape.
Luca D'Urbino for Education Week
Federal Trump's K-12 Record in His First Term Offers a Blueprint for What Could Be Next
In his first term, Trump sought to significantly expand school choice, slash K-12 spending, and tear down the U.S. Department of Education.
11 min read
Education Secretary Betsy DeVos listens at left as President Donald Trump speaks during a round table discussion at Saint Andrew Catholic School on March 3, 2017, in Orlando, Fla.
Education Secretary Betsy DeVos listens at left as President Donald Trump speaks during a round table discussion at Saint Andrew Catholic School on March 3, 2017, in Orlando, Fla. The education policies Trump pursued in his first term offer clues for what a second Trump term would look like for K-12 schools.
Alex Brandon/AP
Federal From Our Research Center How Educators Say They'll Vote in the 2024 Election
Educators' feelings on Vice President Kamala Harris and former President Donald Trump vary by age and the communities where they work.
4 min read
Jacob Lewis, 3, waits at a privacy booth as his grandfather, Robert Schroyer, fills out his ballot while voting at Sabillasville Elementary School, Nov. 8, 2022, in Sabillasville, Md.
Jacob Lewis, 3, waits at a privacy booth as his grandfather, Robert Schroyer, fills out his ballot while voting at Sabillasville Elementary School, Nov. 8, 2022, in Sabillasville, Md.
Julio Cortez/AP
Federal Q&A Oklahoma State Chief Ryan Walters: 'Trump's Won the Argument on Education'
The state schools chief's name comes up as Republicans discuss who could become education secretary in a second Trump administration.
8 min read
Ryan Walters, then-Republican candidate for Oklahoma State Superintendent, speaks at a rally, Nov. 1, 2022, in Oklahoma City.
Ryan Walters speaks at a rally on Nov. 1, 2022, in Oklahoma City as a candidate for state superintendent of public instruction. He won the race and has built a national profile for governing in the MAGA mold.
Sue Ogrocki/AP