69ý

School & District Management

ECS Review Discounts Study Critical of Teaching Board

By Mary Ann Zehr — October 02, 2002 3 min read
  • Save to favorites
  • Print
Email Copy URL

Based on a review by independent researchers, the Education Commission of the States is discounting the conclusions of a small study that showed teachers from Tennessee who received national board certification did not markedly affect their students’ achievement.

“The study is fundamentally flawed,” said Ted Sanders, the president of the Denver-based ECS, which commissioned the report. The study’s methodology had so many problems and the number of participants in the study was so small that the findings are not valid, he contended.

Read the ECS’s of the Tennessee study. The ECS also provides .

The study in question, was conducted by John E. Stone, an education professor at East Tennessee State University in Johnson City, examined yearly test-score increases of Tennessee students in classrooms taught by 16 teachers who had received certification from the National Board for Professional Teaching Standards. It concludes that the gains of the students of the board-certified teachers didn’t exceed those of students of other teachers. (“Critical Study of NBPTS Spurs State Advisory Group to Act,” May 15, 2002.)

Mr. Stone has strongly criticized states for endorsing national board certification, primarily through financial bonuses to teachers who receive such recognition, when no one has proved that such teachers have raised their students’ achievement.

“I think that policymakers have once again bought in to something here that was unsubstantiated,” Mr. Stone said last week in an interview. “We’ve had one fad after another and spent zillions. No one wants to back away from it now that they are on a roll.”

Mr. Sanders, however, said that state policymakers have endorsed national board certification “for a lot of reasons other than a hunch that there is a relationship between those teachers and student achievement.” Many state policymakers believe that, in the long term, the teachers who undergo the rigorous certification process will produce good results, he said.

Faulty Methods?

The review of Mr. Stone’s seven-page study, which he unveiled last spring, does not charge that his conclusions are wrong, but rather that the methods that led to his conclusions were faulty.

For instance, it argues that Mr. Stone did not adequately describe the participants in his study, such as noting when they had received their board certification or how their qualifications compared with those of other board- certified teachers.

Mr. Stone explained that he did not provide descriptive information because Tennessee did not release it to him. He said he could have easily explained that to the researchers who were asked to review his study—and were paid $11,000 to do so—had they asked him. They didn’t.

Susan H. Fuhrman, a University of Pennsylvania researcher who headed the review, said Mr. Stone should have explained why he was lacking descriptive data in the actual study in a way that would have been clear to any reader. Other reviewers on the panel were Dominic Brewer, the director of education at the RAND Corp.; Robert Linn, a professor of education at the University of Colorado, Boulder; and Ana Maria Villegas, a professor of curriculum and teaching at Montclair State University in Upper Montclair, N.J.

Also, the reviewers point out that Mr. Stone had three years of student-achievement data available for only six of the teachers he studied, not all 16. Because Tennessee considers anything less than three years of data unofficial as a result of its volatility, Mr. Stone’s findings apply only to six teachers, the reviewers argue.

“I certainly don’t think one would base a recommendation for a whole national system on a sample of six teachers, especially an undescribed sample of six teachers,” Ms. Fuhrman said.

Mr. Stone stands by his findings and criticizes the ECS for narrowing in on his study for scrutiny rather than taking a look at all the studies that have examined national board certification.

Mr. Sanders says that the ECS does have plans to look at other studies on the research subject as well.

“We’ve been working to try to get a better handle on what constitutes evidence, and how we can look at research and make some judgments about it in the areas where state policies are involved,” he said.

Just last month, the board announced 22 studies it will underwrite to help assess its impact on teaching and learning. (“Standards Board Identifies Research to Examine Effects,” Sept. 18, 2002.)

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Artificial Intelligence Webinar
AI and Educational Leadership: Driving Innovation and Equity
Discover how to leverage AI to transform teaching, leadership, and administration. Network with experts and learn practical strategies.
Content provided by 
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School Climate & Safety Webinar
Investing in Success: Leading a Culture of Safety and Support
Content provided by 
Assessment K-12 Essentials Forum Making Competency-Based Learning a Reality
Join this free virtual event to hear from educators and experts working to implement competency-based education.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.

Read Next

School & District Management Spooked by Halloween, Some 69ý Ban Costumes—But Not Without Pushback
69ý are tweaking Halloween traditions to make them more inclusive to all students.
4 min read
A group of elementary school kids sitting on a curb dressed in their Halloween costumes.
iStock/Getty
School & District Management 69ý Take a $3 Billion Hit From the Culture Wars. Here’s How It Breaks Down
Culturally divisive conflicts in schools have led to increased legal and security costs, as well as staff time spent on the fallout.
4 min read
Illustration of a businessman with his hands on his head while he watches dollars being sucked down into a dark hole.
DigitalVision Vectors
School & District Management Opinion The Blind Spot More Educators Need to Recognize
A simple activity in a training session caused a chain reaction that strengthened an educator's leadership for decades to come.
5 min read
Screen Shot 2024 10 29 at 9.19.10 AM
Canva
School & District Management Opinion 9 Ways 69ý Can Improve Life for Teachers and 69ý
Educators suggest low-cost strategies to improve the education experience for teachers and learners alike.
8 min read
Conceptual illustration of classroom conversations and fragmented education elements coming together to form a cohesive picture of a book of classroom knowledge.
Sonia Pulido for Education Week