69ý

Federal

Impact Is Slight for Early States Using ‘Growth’

By Alyson Klein — December 18, 2007 5 min read
  • Save to favorites
  • Print
Email Copy URL

“Growth models” are being held out as a better way to hold schools accountable than the method the No Child Left Behind Act uses now. But in an experiment with such models, they don’t appear to be making a big difference in the proportion of schools meeting annual goals under the federal law, an analysis by the Editorial Projects in Education Research Center concludes.

See Also

Six of the nine states participating in the U.S. Department of Education’s growth-model pilot project provided information to the EPE Research Center detailing the number of schools making adequate yearly progress, or AYP, under the growth model. Under a growth model, states measure individual students’ progress instead of comparing test scores of a cohort of students against those of students in the same grade during the previous year.

In most cases in the pilot states, only a small percentage of schools made AYP using the growth model alone. Most schools that made AYP under the growth model also hit the law’s achievement targets under the standard accountability model used in most of those states.

Accountability experts and state education officials attribute the relatively small impact of growth models in part to the stringent structure that the Education Department has established for states participating in the pilot project.

“The department has pretty tough rules on what qualifies for growth models … to make sure that this wasn’t just a free ride for schools,” said Eric A. Hanushek, a senior fellow at the Hoover Institution, based at Stanford University, who has advised the department on the issue.

The growth models in the pilot program must follow a set of “bright line” principles under the pilot project. For instance, the accountability plans must adhere to the NCLB law’s target that all students be achieving at the proficient level on state tests by the end of the 2013-14 school year. Like standard state accountability plans approved under the law, also referred to as “status models,” acceptable growth models must hold schools accountable for the performance of subgroups of students, such as racial and ethnic minorities or students with disabilities.

State officials and accountability experts point out that many states use statistical techniques in their status models to ensure that schools aren’t improperly labeled as not making AYP. Such techniques are generally barred under growth models. That distinction may help explain why some schools made AYP under the status model, but not under a growth model, and why the use of growth models benefited so few schools in some of the pilot states.

Alaska, Arizona, Delaware, Florida, Iowa, and North Carolina all submitted information for the EPE Research Center’s analysis. Arkansas and Tennessee are also participating in the pilot project, but did not provide data to the research center in time for the analysis. Ohio has also been selected for the pilot project, but it must tweak its accountability plan before it can employ the growth model.

Paths to Adequate Yearly Progress

BRIC ARCHIVE

NOTES:

* Three states participating in the growth-model pilot are not represented in this analysis. Arkansas and Tennessee did not provide data to the EPE Research Center as of publication. Ohio may not employ its growth model until it adopts a uniform minimum group size for AYP calculations.

** Arizona and Delaware exclude certain schools from growth-model calculations based on size and/or grades served. For these states, this analysis includes only schools for which both the traditional and growth-model calculations were performed.

SOURCE: EPE Research Center, 2007

Statistical techniques used in status models include what are called confidence intervals, which permit a school, or a subgroup, to make AYP even if it misses its target, as long as its performance falls within a band set around that target, similar to the margin of error in polling data. States also employ “safe harbor” provisions, which were included in the law; those provisions allow schools credit for making adequate progress as long as more students maintained or moved up to proficiency in the current school year than in the previous one.

The Education Department does not permit states to use those techniques with their growth models, so many schools are still labeled as not making adequate progress.

“The rules are limiting the potential benefits of growth models, but it’s definitely a step in the right direction,” said Pete Goldschmidt, an assistant professor of education at California State University- Northridge.

For instance, Alaska applied its growth model both to schools that made AYP under the traditional status model and to those that did not. No school in the state made AYP under the growth model that did not qualify under the status model.

In fact, 150 schools made AYP under the original status model, but would not have under the growth model alone.

Les Morse, the director of assessments and accountability for the Alaska Department of Education and Early Development, attributed those results in part to the state’s use of confidence intervals and the safe-harbor provision. He said the state at first sought to include those techniques in its growth model, but the federal Education Department rejected the proposal.

Even though growth models haven’t changed the label of many schools, officials in participating states say they are learning from taking part in the pilot.

Growth models provide “instructionally valuable” information for schools to “really get them to think about where [an individual] kid should be next year,” Mr. Morse said.“We didn’t have that kind of information until this growth model moved us to produce it.”

Growth models also enable states to recognize teachers and schools that deal effectively with students at various levels of proficiency, said Thomas E. Deeter, a lead accountability consultant for the Iowa Department of Education.

The analysis by the EPE Research Center, which is affiliated with Education Week, shows that growth models made a more dramatic difference in some states than in others. North Carolina applied a growth model only to schools that did not make adequate yearly progress under the status model. Just 12 schools made AYP under the growth model that would not have made it under the status model, or about 1 percent of all 1,052 schools in the state that made AYP.

By contrast, about 14 percent of the schools that made AYP in Florida made it under the growth model but not the status model. Like North Carolina, Florida applied the growth model only to schools that did not initially make AYP under the status model.

Mr. Hanushek of the Hoover Institution suggested that the use of a growth model might have made more of a difference in Florida than in North Carolina because more students are already at the proficient level under North Carolina’s standards. Florida’s standards, he said, are generally more closely aligned with the National Assessment of Educational Progress, the federal program known as “the nation’s report card,” and so are more rigorous.

“That has an influence,” Mr. Hanushek said.

Florida officials said they hadn’t studied North Carolina’s accountability plan or standards closely enough to say whether they agree with that conclusion. They pointed out that growth in achievement was already a factor in Florida’s accountability system, so schools were paying close attention to individual students’ progress even before the growthmodel pilot.

“We were actually quite pleased with the impact we saw with [the growth model],”said Juan Copa, the bureau chief for evaluation and reporting at the Florida Department of Education.

Associate Editor David J. Hoff contributed to this report.
A version of this article appeared in the December 19, 2007 edition of Education Week as Impact Is Slight for Early States Using ‘Growth’

Events

School & District Management Webinar Crafting Outcomes-Based Contracts That Work for Everyone
Discover the power of outcomes-based contracts and how they can drive student achievement.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School & District Management Webinar
Harnessing AI to Address Chronic Absenteeism in 69ý
Learn how AI can help your district improve student attendance and boost academic outcomes.
Content provided by 
School & District Management Webinar EdMarketer Quick Hit: What’s Trending among K-12 Leaders?
What issues are keeping K-12 leaders up at night? Join us for EdMarketer Quick Hit: What’s Trending among K-12 Leaders?

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.

Read Next

Federal What a National School Choice Program Under President Trump Might Look Like
School choice advocates—and detractors—see a second Trump term as the biggest opportunity in decades for choice at the federal level.
8 min read
President Donald Trump listens during a "National Dialogue on Safely Reopening America's 69ý," event in the East Room of the White House, on July 7, 2020, in Washington.
President Donald Trump listens during a "National Dialogue on Safely Reopening America's 69ý," event in the East Room of the White House on July 7, 2020, in Washington. He returns to power with more momentum than ever behind policies that allow public dollars to pay for private school education.
Alex Brandon/AP
Federal Trump's Education Secretary Pick Is Linda McMahon, Former WWE CEO
McMahon led the Small Business Administration in Trump's first term and is co-chair of the president-elect's transition team.
6 min read
Small Business Administration Administrator Linda McMahon speaks during a news conference with President Donald Trump in Trump's Mar-a-Lago estate in Palm Beach, Fla., Friday, March 29, 2019.
Then-SBA Administrator Linda McMahon speaks during a news conference with President Donald Trump at Trump's Mar-a-Lago estate in Palm Beach, Fla., Friday, March 29, 2019. Trump has tapped McMahon to serve as education secretary in his second term.
Manuel Balce Ceneta/AP
Federal What Could RFK Jr. as HHS Secretary Mean for School Vaccine Requirements?
The vaccine skeptic in line to lead the mammoth federal agency could influence schools' vaccine rules, even though they're set by states.
6 min read
Robert F. Kennedy, Jr., speaks before Republican presidential nominee former President Donald Trump at a campaign event, Friday, Sept. 27, 2024 in Walker, Mich.
Robert F. Kennedy, Jr., speaks before President-elect Donald Trump at a campaign event on Sept. 27, 2024 in Walker, Mich. Trump has selected Kennedy to serve as secretary of health and human services in his second term.
Carlos Osorio/AP
Federal Can Trump Force 69ý to Change Their Curricula?
Trump's bid to take money from schools that teach "critical race theory" or pass policies for transgender kids raises legal complexities.
9 min read
Republican presidential nominee former President Donald Trump speaks on crime and safety during a campaign event at the Livingston County Sheriff's Office, Tuesday, Aug. 20, 2024, in Howell, Mich.
Republican presidential nominee former President Donald Trump speaks on crime and safety during a campaign event at the Livingston County Sheriff's Office, Tuesday, Aug. 20, 2024, in Howell, Mich.
Evan Vucci/AP