69传媒

Only 10 of the 18 most widely used school improvement programs for middle and high schools have 鈥渕辞诲别谤补迟别鈥� or 鈥渓颈尘颈迟别诲鈥� evidence to show they work, and none deserves a top rating, a review by a Washington think tank concludes.

The review, released last week at a national conference in Houston, is the third in a series of consumer-style reports produced by the Comprehensive School Reform Quality Center at the American Institutes for Research. The federally financed reviews evaluate the research base for popular, prepackaged schoolwide-improvement designs and assign ratings based on their effectiveness and other characteristics.

is posted by the .

This time around, none of the models had a research track record robust enough to earn one of the nonprofit group鈥檚 two highest ratings鈥斺�渧ery strong鈥� or 鈥渟trong.鈥� Nonetheless, Steve Fleischman, the AIR vice president who oversees the project, characterized the results for secondary schools as encouraging.

鈥淧art of this, I think, is that it鈥檚 really hard to do research at the high school or middle school level,鈥� he said, 鈥渁nd some of the models are newer, so they haven鈥檛 had time to establish a research base.鈥�

鈥淏ut if we had done this a year and a half ago, there would have been even less evidence,鈥� he added, describing 2005 as 鈥渁 really good year for research.鈥�

The four programs rated moderate for their effectiveness were: America鈥檚 Choice School Design, based in Washington; the School Development Program, the model developed by the Yale University psychologist James P. Comer; and Success for All鈥擬iddle Grades and Talent Development High School, both designed by researchers at Johns Hopkins University in Baltimore.

At the other end of the scale, no programs were found to lack any research evidence at all or to have a negative impact on student achievement. But the center鈥檚 analysts gave eight programs a rating of 鈥渮ero,鈥� meaning the studies found for those programs were not rigorous enough.

The center bases its standards on the federal government鈥檚 definition of 鈥渟cientifically based research,鈥� which tends to favor studies that use comparison and control groups.

Higher Standards

Among the zero-rated programs were well-established improvement models, such as High 69传媒 That Work, of Atlanta; Accelerated 69传媒 PLUS, of Storrs, Conn.; the Coalition of Essential 69传媒, based in Oakland, Calif.; and Modern Red Schoolhouse, of Nashville, Tenn.

鈥淲e knew we did not have the kind of research where you have control groups. We鈥檝e never had the resources to do that, but we鈥檇 welcome it,鈥� said Gene Bottoms, the senior vice president of the Southern Regional Education Board, which founded High 69传媒 That Work 20 years ago.

Used in 1,100 schools nationwide, that model got a stronger rating from the think tank seven years ago, when it undertook a similar review of improvement programs. But the research group鈥檚 research-quality standards for the current project are tougher. Of the 1,500 effectiveness studies the center reviewed for the secondary school report, only 41 made the cut.

The reviewers, who concentrated on programs used in at least 40 sites and three or more states, also rated programs on other characteristics besides effectiveness. Analysts looked, for example, to see whether the programs are particularly effective with diverse student populations, whether they lead more families to become involved in schooling, and whether they provide needed services and support for schools.

The ratings for secondary school programs were not as high as they were for elementary schools, which were the focus of the center鈥檚 first report in 2005. (鈥淩eport Critiques Evidence on School Improvement Models,鈥� Dec. 7, 2005.) That review, which has since been downloaded from the center鈥檚 Web site more than 50,000 times, gave 鈥渕oderately strong鈥� effectiveness to two programs and moderate ratings to five others.

Nevertheless, Mr. Fleischman said the secondary school report and an updated version of the elementary school report due out later this fall may be the center鈥檚 last. Its three-year, $4 million grant to vet the research on comprehensive school reform models runs out next month, and the U.S. Department of Education鈥檚 office of elementary and secondary education has no plans to extend it.

Mr. Fleischman said the AIR would continue to make the center鈥檚 reports available on its Web site.