69ý

Federal

Debate About Impact of Ed Tech on Test Scores Fueled by Study

By Jason Kazi — September 13, 2016 5 min read
  • Save to favorites
  • Print
Email Copy URL

The latest attempt by researchers to determine the impact of educational technology investments on student achievement suggests that federal E-rate program subsidies that schools receive are unlikely to improve student test scores.

This new study could fuel debates about the link between technology investments and student achievement. But several ed-tech experts said the premise of the study is largely misguided and some of the methodology is flawed.

The research—conducted by scholars at Clemson University’s Department of Economics and the Georgetown Center for Business and Public Policy—shows no direct correlation between the use of annual E-rate subsidies and SAT scores in North Carolina’s public schools.

In North Carolina, composite SAT test scores fell as E-rate funding increased. That led the researchers to suggest that districts aren’t getting the return on investment that they should from spending thousands of dollars on added technology in their classrooms.

“The argument that was made to increase the [E-rate] funding up to $4 billion per year was that there was a positive outcome,” said Thomas Hazlett, a professor of economics at Clemson and one of the study’s authors. “We need to show increased test scores to be able to support the next $4 billion of investments.”

But suggesting that the districts are not getting a valuable return on investment based solely on SAT scores is a conclusion full of problems, several experts said.

To begin with, both K-12 leaders and the Federal Communications Commission agree that the intended purpose of the E-rate program from the very beginning has always been to provide a level playing field for all school districts in terms of access to technology, not as a direct means to increase test scores. Plus, they say it is problematic to suggest that E-rate funding would have a direct link to test scores, because there are so many other factors that influence academic performance.

Mixed Picture

The findings show that as E-rate funding rose in North Carolina during the 2009-2013 period, average mathematics SAT test scores actually dropped from 493 to 481. The average written SAT test score also dropped from 454 in 2009 to 448 in 2013. However, average critical reading SAT test scores saw a slight increase.

While the study claims to “adjust for demographic differences,” it does not clearly outline which factors are being used to distinguish a wealthy school district from a poorer school district.

Academic Return From the E-rate?

A new study conducted by researchers at Clemson and Georgetown universities attempts to examine the link between the E-rate program and student achievement.

The study:

  • COMPARES rising E-rate investments with SAT scores for students across North Carolina between 1999 and 2013;
  • EXAMINES the performance of students in Mooresville, N.C., a district with an international reputation for its extensive use of digital learning;
  • BASES its conclusions on the performance of students in 374 high schools in 119 districts;
  • CONCLUDES that, in most cases, the correlation between E-rate funding and SAT scores is negative;
  • SUGGESTS that policymakers need to take a harder look at the return on investment from the E-rate program.

Source: Clemson University, Georgetown University

The study also specifically examined the Mooresville County schools, a district with an international reputation for its extensive use of educational technology. The results from Mooresville present a mixed picture.

They show that as E-rate funding rose in North Carolina during the 2009-2013 period, average mathematics SAT test scores for the district dropped to a low of 499 in 2012 before returning to 520 in 2013. The average written SAT test scores in Mooresville dropped to a low of 457 in 2011 before returning to 482 in 2013. Additionally, the average critical reading SAT test scores dropped to a low of 478 in 2011 before returning to 500 in 2013.

“The article attempts to correlate SAT performance with federal E-rate program spending,” said Brendan Desetti, the director of education policy at The Software & Information Industry Association. “However, only about half of all high school students take the SAT and the majority of test takers are not low-income students. The E-rate program, on the other hand, provides subsidies for broadband connectivity to schools and libraries based on the number of low-income individuals served. Higher-income students, those more likely to participate in the SAT, are also shown to be more likely to have access to high-speed internet and other technology outside of the classroom.”

Other studies cloud the picture about the impact of technology investments on student achievement. For instance, a 2015 study by the Organization for Economic Cooperation and Development found that ed-tech investments made in 31 countries did not lead to improved student achievement. However, a Michigan State University meta-analysis released in 2016 showed a link between improved test scores and access to computers.

EducationSuperHighway, a nonprofit working to bring internet to every classroom in the United States to enhance digital learning opportunities, has been a big advocate for E-rate funding across the country.

“The most important thing with the E-rate program is for it to continue to focus on how we are achieving the goals and to make sure that schools and school districts (the beneficiaries) have the tools that they need to be the most effective purchasers of broadband that they can be,” said Evan Marwell, the founder and CEO of EducationSuperHighway. “They can ensure that the taxpayers’ money is used in the best way possible.”

Study ‘Fundamentally Flawed’

The FCC overhauled and modernized the E-rate program in late 2015 by using data to drive its policy changes.

In collaboration with educational nonprofit organizations, the FCC felt the need to move the program away from basic telephone lines to fiber-optic broadband connectivity. The policy changes expanded the options school districts had to build up their Wi-Fi infrastructure.

Most educational experts say today’s classrooms must be both broadband and Wi-Fi-capable to allow teachers and students to use technology in the most effective ways.

According to data gathered by EducationSuperHighway, 5 million public schools had broadband in 2014. That number grew to 27 million public schools in 2015. This increase can largely be attributed to the FCC’s modernization of the E-rate program, according to ed-tech experts. FCC data also caused the agency to make all of its E-rate data pertaining to who’s buying what, from whom, and at what price open to the public. As a result, the cost paid by schools for broadband has been cut in half since 2014, from $22 per megabit to $11 per megabit.

“I think that overall the study [by Clemson and Georgetown] is fundamentally flawed,” said Marwell. “The E-rate program has made a level playing field by providing every student and teacher in the country with equal and efficient access to the Internet. The E-rate program is about access, not achievement. The people who know teaching and learning the best are in the classroom and improving learning for children.”

FCC officials echoed Marwell.

“The Telecommunications Act of 1996 directed the FCC to provide schools and libraries with broadband, which is exactly what the E-rate program is doing,” said Mark Wigfield, deputy director of the office of media relations at the FCC. “While we can’t comment on the study’s analysis of educational outcomes, the demand for E-rate funding from schools and libraries makes it clear that access to broadband is essential to learning today.”

Events

School & District Management Webinar Crafting Outcomes-Based Contracts That Work for Everyone
Discover the power of outcomes-based contracts and how they can drive student achievement.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School & District Management Webinar
Harnessing AI to Address Chronic Absenteeism in 69ý
Learn how AI can help your district improve student attendance and boost academic outcomes.
Content provided by 
School & District Management Webinar EdMarketer Quick Hit: What’s Trending among K-12 Leaders?
What issues are keeping K-12 leaders up at night? Join us for EdMarketer Quick Hit: What’s Trending among K-12 Leaders?

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.

Read Next

Federal What a National School Choice Program Under President Trump Might Look Like
School choice advocates—and detractors—see a second Trump term as the biggest opportunity in decades for choice at the federal level.
8 min read
President Donald Trump listens during a "National Dialogue on Safely Reopening America's 69ý," event in the East Room of the White House, on July 7, 2020, in Washington.
President Donald Trump listens during a "National Dialogue on Safely Reopening America's 69ý," event in the East Room of the White House on July 7, 2020, in Washington. He returns to power with more momentum than ever behind policies that allow public dollars to pay for private school education.
Alex Brandon/AP
Federal Trump's Education Secretary Pick Is Linda McMahon, Former WWE CEO
McMahon led the Small Business Administration in Trump's first term and is co-chair of the president-elect's transition team.
6 min read
Small Business Administration Administrator Linda McMahon speaks during a news conference with President Donald Trump in Trump's Mar-a-Lago estate in Palm Beach, Fla., Friday, March 29, 2019.
Then-SBA Administrator Linda McMahon speaks during a news conference with President Donald Trump at Trump's Mar-a-Lago estate in Palm Beach, Fla., Friday, March 29, 2019. Trump has tapped McMahon to serve as education secretary in his second term.
Manuel Balce Ceneta/AP
Federal What Could RFK Jr. as HHS Secretary Mean for School Vaccine Requirements?
The vaccine skeptic in line to lead the mammoth federal agency could influence schools' vaccine rules, even though they're set by states.
6 min read
Robert F. Kennedy, Jr., speaks before Republican presidential nominee former President Donald Trump at a campaign event, Friday, Sept. 27, 2024 in Walker, Mich.
Robert F. Kennedy, Jr., speaks before President-elect Donald Trump at a campaign event on Sept. 27, 2024 in Walker, Mich. Trump has selected Kennedy to serve as secretary of health and human services in his second term.
Carlos Osorio/AP
Federal Can Trump Force 69ý to Change Their Curricula?
Trump's bid to take money from schools that teach "critical race theory" or pass policies for transgender kids raises legal complexities.
9 min read
Republican presidential nominee former President Donald Trump speaks on crime and safety during a campaign event at the Livingston County Sheriff's Office, Tuesday, Aug. 20, 2024, in Howell, Mich.
Republican presidential nominee former President Donald Trump speaks on crime and safety during a campaign event at the Livingston County Sheriff's Office, Tuesday, Aug. 20, 2024, in Howell, Mich.
Evan Vucci/AP