69传媒

69传媒 & Literacy

Scantronning Shakespeare

By Kevin Bushweller 鈥 August 10, 2006 2 min read
  • Save to favorites
  • Print
Email Copy URL

English teacher Aleeta Johnson first saw an advertisement for essay-grading software while attending a Florida Educational Technology Conference in Orlando six years ago. Her initial reaction was skepticism, bordering on disbelief.

鈥淚 thought, oh, that鈥檚 too good to be true,鈥 says Johnson, who works at Farragut High School in Knoxville, Tennessee. 鈥淗ow could a computer grade an essay?鈥

BRIC ARCHIVE

But since then, Johnson has become a true believer in the power of essay-grading technology鈥攅specially Educational Testing Service鈥檚 Criterion Online Writing Evaluation, which is used in her district. Now the 22-year-teaching veteran can鈥檛 imagine life without Criterion because it has freed up her time to assign an 鈥渁stronomically鈥 higher number of writing assignments than she did before she used the technology.

Many other teachers have also seen the wisdom of writing-evaluating software, fueling the proliferation of titles such as Writing Roadmap 2.0, a product of CTB/McGraw-Hill; IntelliMetric by Vantage Learning; WriteToLearn by Pearson Knowledge Technologies; and SAGrader by Idea Works Inc.Each program works a little differently. Some, such as Criterion, assess the quality of sentence organization, grammar, usage, and style, but do not evaluate content. Others use artificial intelligence to evaluate the quality of an essay on a particular topic.

Shortly before Johnson attended that Florida technology conference, I wrote a story about essay-grading software. At the time, I was also very skeptical that it would somehow revolutionize the teaching of writing. It seemed more hype than reality, and there was debate raging among researchers about the accuracy and effectiveness of the essay-grading engines. Plus, as a writer and editor, the thought that a machine could replace the craft of evaluating a piece of writing made me cringe a bit. Writing, to me, has always been a quintessentially human experience.

But I do not have to teach writing to more than 150 students in the course of a school year, as Johnson does. And that鈥檚 why her experience, not my perspective, carries more weight. In 2002-03, when Criterion was used to grade essays at all 12 of her district鈥檚 high schools, writing scores on a subsequent standardized test of 11th graders鈥 persuasive writing rose 8 points. At one high school where a writing-across-the-curriculum program was put in place in tandem with Criterion, 11th graders鈥 scores jumped 19 points that year.

Even so, Criterion and other essay-grading technologies have their limitations. They can鈥檛 judge the creativity of a writing style or the inventiveness of metaphors and symbolism. And I remain skeptical that artificial intelligence can effectively differentiate between a good essay and a truly excellent one.

Johnson acknowledges that Criterion is not a good tool for very sophisticated writers. It wouldn鈥檛 appreciate the skill and creativity of a budding Shakespeare, for example.

But the reality, Johnson says, is that budding Shakespeares make up less than 1 percent of her students. The other 99 percent, she says, are best served by the modern duo of teacher and machine.

Related Tags:

Events

School & District Management Webinar Crafting Outcomes-Based Contracts That Work for Everyone
Discover the power of outcomes-based contracts and how they can drive student achievement.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School & District Management Webinar
Harnessing AI to Address Chronic Absenteeism in 69传媒
Learn how AI can help your district improve student attendance and boost academic outcomes.
Content provided by 
School & District Management Webinar EdMarketer Quick Hit: What鈥檚 Trending among K-12 Leaders?
What issues are keeping K-12 leaders up at night? Join us for EdMarketer Quick Hit: What鈥檚 Trending among K-12 Leaders?

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide 鈥 elementary, middle, high school and more.
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.

Read Next

69传媒 & Literacy What Teachers Say They Need Most to Help Struggling Teen Readers
Educators also want more time in the school day to work on reading skills, a new survey finds.
4 min read
Close cropped photo of an open book with a teen girl's eyes peering over the top of the book.
Jack Hollingsworth/Getty
69传媒 & Literacy Opinion Boys Don't Love to Read. Could This Former Teacher Be on to Something?
Boys are falling behind in reading. Books with military-history themes may help reverse this trend.
7 min read
The United States Capitol building as a bookcase filled with red, white, and blue policy books in a Washington DC landscape.
Luca D'Urbino for Education Week
69传媒 & Literacy Is Handwriting a Lost Art? What One College鈥檚 Kerfuffle Over Cursive Can Tell Us
Since 2014, there鈥檚 been a resurgence of cursive and handwriting education.
6 min read
A photograph of a close up of cursive handwriting that is undecipherable
E+
69传媒 & Literacy Quiz Quiz Yourself: How Much Do You Know About Student Literacy Data?
Answer 7 questions about the importance of student literacy data and how to collect and use it.