69传媒

Federal

N.Y.C. Charters Found to Close Gaps

By Debra Viadero 鈥 September 22, 2009 6 min read
  • Save to favorites
  • Print
Email Copy URL

New York City鈥檚 charter schools are making strides in closing achievement gaps between disadvantaged inner-city students and their better-off suburban counterparts, a .

The study, conducted by Stanford University researcher Caroline M. Hoxby and her co-authors Sonali Mararka and Jenny Kang, is based on eight years of data for students applying to the city鈥檚 growing number of charter schools. It finds, for instance, that attending a charter school from kindergarten to 8th grade can close the achievement gap with a similar student in the affluent suburb of Scarsdale, N.Y., by 86 percent in mathematics and 66 percent in reading. By comparison, the 鈥淗arlem-Scarsdale鈥 gap only widens over the same span of grades for students who remain in regular public schools, according to the study.

For high school students, the study also found, attending a charter school increased the likelihood that a student would earn a state Regents diploma by age 20 by 7 percent for each year spent in that school.

Charter schools, which are public schools allowed to operate largely independent of many traditional school district rules, are a major focus of the Obama administration鈥檚 education plans. Federal education officials have made it clear, in fact, that states deemed unfriendly to charter schools will be last in line for economic-stimulus funds from the $4 billion Race to the Top program. (鈥淥bama Team鈥檚 Advocacy Boosts Charter Momentum,鈥 June 17, 2009.)

Studies comparing student achievement in charter schools with that in regular public schools are difficult to do credibly, however, because students who apply and their families are presumably more motivated to succeed in school than those who remain in regular schools.

Ms. Hoxby was able to overcome that problem in New York City because its charter schools are oversubscribed, requiring administrators to use lotteries to allocate seats. According to Ms. Hoxby鈥檚 report, 94 percent of the students in the city鈥檚 charter schools got there by lottery.

That allowed researchers to compare students randomly assigned to charters with students who applied but did not win a seat in a charter school, thus providing for a more apples-to-apples comparison.

How Generalizable?

The promising findings contrast sharply with those from a widely reported national study published this past summer by the Center for Research on Education Outcomes, which is also based at Stanford. In that study, CREDO Director Margaret E. Raymond examined data for 2,403 charters schools in 15 states and the District of Columbia. She found that students in more than 80 percent of the charter schools performed the same as, or worse than, students in regular public schools on mathematics tests. (鈥淪tudy Casts Doubt on Charter School Results,鈥 June 15, 2009.)

鈥淎s with all studies of charter schools, you have to look at what you鈥檙e comparing,鈥 said Ellen B. Goldring, a professor of education policy and leadership at the National Center on School Choice, at Vanderbilt University in Nashville, Tenn. Ms. Hoxby鈥檚 study was financed by the federal Institute of Education Sciences through the center.

鈥淐learly, the lottery method is the gold standard,鈥 Ms. Goldring added, 鈥渂ut it is one locale and it is generalizable only to schools with oversubscribed lotteries.鈥

鈥淭he CREDO study is looking across states and using a matching method, so they鈥檙e just asking different questions,鈥 she said.

Jeffrey Henig, a professor of political science and education at Teachers College, Columbia University, in New York, said the explanation for the differing results could be even simpler.

鈥淚t could just be that New York鈥檚 charter schools are better,鈥 Mr. Henig said. 鈥淭his is a pretty strong study design-wise,鈥 he said of Ms. Hoxby鈥檚 study, 鈥渁nd it shows effects that, if aggregated over time, are substantial.鈥

But another possible explanation for the sharply contrasting results, said Ms. Hoxby, may be that the CREDO findings suffer from a 鈥渟erious mathematical mistake.鈥 The problem, she said in a separate analysis, is that Ms. Raymond compared the achievement of individual charter students with that of groups of students from nearby public schools, without making the statistical adjustments necessary to account for the natural downward biases that result from that sort of calculation.

Ms. Raymond, who was traveling most of yesterday, said in an e-mail message that she was reserving comment on Ms. Hoxby鈥檚 criticism. 鈥淗er comments deserve similar careful attention,鈥 she wrote of Ms. Hoxby, 鈥渁nd we will reserve comment until we have had a full opportunity to consider her memorandum.鈥

Inside 鈥楾he Black Box鈥

In her study, Ms. Hoxby found that, by the 3rd grade, the average charter school student was 5.3 points ahead of lottery 鈥渓osers鈥 on state exams in English and 5.8 points ahead in math. (That鈥檚 on test scales of 475 to 800 points.) After that, the charter school students gained an additional 2.4 to 3.6 points a year beyond the regular public school students who failed to win a charter spot in the lottery.

鈥淲hen you see good results like that coming out of a city like New York, it just makes you realize what鈥檚 possible,鈥 said Robin Lake, the associate director of the Center on Reinventing Public Education, at the University of Washington at Bothell. 鈥淐harter schooling can be an effective tool if done right.鈥

Ms. Hoxby said she calculated the Harlem-Scarsdale achievement gap鈥攁 35- to 40-point spread鈥攖o give New Yorkers a concrete idea of what her statistical results mean.

鈥淚 think when people talk about the achievement gap it鈥檚 unclear what they鈥檙e referring to,鈥 she said. 鈥淪ometimes it鈥檚 black and white, and sometimes it鈥檚 affluent and poor. If you say Scarsdale in New York, people know what that means.鈥

Experts said Ms. Hoxby鈥檚 study is also important because it 鈥済ets inside the black box,鈥 attempting to explore what successful charter schools might be doing differently with their added autonomy. 69传媒 that held classes 10 or more days longer each year tended to produce better student achievement, for example.

鈥淚 think one thing that really came out of the data very strongly is definitely this long school year,鈥 Ms. Hoxby said. 鈥淭hese students start out well behind more-advantaged students, so having them spend longer time in school is a way to make up some of that advantage.鈥

Likewise, researchers found that the average charter school in the study stayed open eight hours a day, with some providing services for as long as 10 hours.

Other school characteristics associated with better student achievement included: more time spent on English instruction; teacher pay plans that were based on teachers鈥 effectiveness at improving student achievement, principals鈥 evaluations, or whether teachers took on additional duties, rather than traditional pay scales; an emphasis on academics in schools鈥 mission statements; and a classroom policy of punishing or rewarding the smallest of student infractions.

Practices that didn鈥檛 seem to affect student achievement, on the other hand, were class size, parent contracts, or the number of years schools were in operation, according to the report.

Ms. Hoxby cautioned, however, that the characteristics the study identified don鈥檛 necessarily cause higher achievement, but might provide some clues for further study.

鈥淚t could also be,鈥 she added, 鈥渢hat these are part of a package of things that have a positive effect on students.鈥

Events

School & District Management Webinar Crafting Outcomes-Based Contracts That Work for Everyone
Discover the power of outcomes-based contracts and how they can drive student achievement.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School & District Management Webinar
Harnessing AI to Address Chronic Absenteeism in 69传媒
Learn how AI can help your district improve student attendance and boost academic outcomes.
Content provided by 
School & District Management Webinar EdMarketer Quick Hit: What鈥檚 Trending among K-12 Leaders?
What issues are keeping K-12 leaders up at night? Join us for EdMarketer Quick Hit: What鈥檚 Trending among K-12 Leaders?

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide 鈥 elementary, middle, high school and more.
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.

Read Next

Federal What a National School Choice Program Under President Trump Might Look Like
School choice advocates鈥攁nd detractors鈥攕ee a second Trump term as the biggest opportunity in decades for choice at the federal level.
8 min read
President Donald Trump listens during a "National Dialogue on Safely Reopening America's 69传媒," event in the East Room of the White House, on July 7, 2020, in Washington.
President Donald Trump listens during a "National Dialogue on Safely Reopening America's 69传媒," event in the East Room of the White House on July 7, 2020, in Washington. He returns to power with more momentum than ever behind policies that allow public dollars to pay for private school education.
Alex Brandon/AP
Federal Trump's Education Secretary Pick Is Linda McMahon, Former WWE CEO
McMahon led the Small Business Administration in Trump's first term and is co-chair of the president-elect's transition team.
6 min read
Small Business Administration Administrator Linda McMahon speaks during a news conference with President Donald Trump in Trump's Mar-a-Lago estate in Palm Beach, Fla., Friday, March 29, 2019.
Then-SBA Administrator Linda McMahon speaks during a news conference with President Donald Trump at Trump's Mar-a-Lago estate in Palm Beach, Fla., Friday, March 29, 2019. Trump has tapped McMahon to serve as education secretary in his second term.
Manuel Balce Ceneta/AP
Federal What Could RFK Jr. as HHS Secretary Mean for School Vaccine Requirements?
The vaccine skeptic in line to lead the mammoth federal agency could influence schools' vaccine rules, even though they're set by states.
6 min read
Robert F. Kennedy, Jr., speaks before Republican presidential nominee former President Donald Trump at a campaign event, Friday, Sept. 27, 2024 in Walker, Mich.
Robert F. Kennedy, Jr., speaks before President-elect Donald Trump at a campaign event on Sept. 27, 2024 in Walker, Mich. Trump has selected Kennedy to serve as secretary of health and human services in his second term.
Carlos Osorio/AP
Federal Can Trump Force 69传媒 to Change Their Curricula?
Trump's bid to take money from schools that teach "critical race theory" or pass policies for transgender kids raises legal complexities.
9 min read
Republican presidential nominee former President Donald Trump speaks on crime and safety during a campaign event at the Livingston County Sheriff's Office, Tuesday, Aug. 20, 2024, in Howell, Mich.
Republican presidential nominee former President Donald Trump speaks on crime and safety during a campaign event at the Livingston County Sheriff's Office, Tuesday, Aug. 20, 2024, in Howell, Mich.
Evan Vucci/AP