States are grappling with the task of creating alternate assessments for students with significant cognitive disabilities that will pass muster with federal officials for use under the No Child Left Behind Act.
Such assessments show promise for spurring the academic performance of students who cannot take general tests even with special accommodations, such as extra time or use of calculators. But coming up with alternate tests for such students that are technically sound and measure the skills they are intended to gauge has been a challenge for many states, recent U.S. Department of Education reviews of state testing systems suggest.
Alternate assessments required under federal law for students with significant cognitive disabilities fall into three broad categories.
Portfolio Assessment:
An organized gathering of student work that illustrates a student鈥檚 skills and is measured against predetermined scoring criteria.
Performance Assessment:
A task or series of tasks requiring a student to provide a response or create a product to show mastery of a specific skill or content standard.
Rating Scales or Checklist Assessment:
Teacher observation of a student鈥檚 skills over a period of time, measured against a state-created scoring guide.
SOURCES: National Center for Educational Outcomes; Council of Chief State School Officers
Unlike tests given to the general student population, which often use identical items and are scored by third parties, alternate assessments are tailored to each student鈥檚 method of communication. Some students may only be able to communicate through eyeblinks that control computers; others may be able to manipulate response cards.
The Education Department leaves it up to each state to determine just what a 鈥渟ignificant鈥� cognitive impairment is. The department does say that research suggests no more than 1 percent of the student population鈥攁bout 10 percent of all students with disabilities鈥攕hould fall into that category.
Under federal rules for testing under the No Child Left Behind law, up to 1 percent of a district鈥檚 or school鈥檚 testing population can take alternate assessments and have their 鈥減roficient鈥� or 鈥渁dvanced鈥� scores count in the district鈥檚 or school鈥檚 calculation for showing adequate yearly progress鈥攖he law鈥檚 key accountability measure. According to the federal government, those assessments must meet the same technical standards as other tests given by a state under the 4陆-year-old law.
In letters the Education Department sent early in the summer, 37 states, Puerto Rico, and the District of Columbia were asked to submit more documentation in support of their alternate assessments. They were asked to show, for instance, that those assessments are aligned to state academic-content standards, that the scoring of such tests would produce similar results among students with similar skill levels, and that there are well-developed performance 鈥渄escriptors鈥� that explain what skills a student must have to be scored at various levels, such as basic, proficient, or advanced.
Difficulties Foreseen
Testing experts say it鈥檚 no surprise that states are struggling with their tests for students with the many disorders and injuries that may result in significant cognitive impairments. The field is still in its infancy, they note.
First mandated with the 1997 reauthorization of the Individuals with Disabilities Education Act, alternate assessments were, in some states, tied to the individualized education program, or IEP, of the particular student. The fact that such students were being tested at all was considered more important than the quality of the tests, and the tests were not included in accountability measures.
The No Child Left Behind law changed that, by requiring that all tests be included in accountability determinations and meet high technical standards. In December 2003, the Education Department issued regulations on the technical qualities such tests must meet in order for the results to count under the federal law.
Several department-funded efforts to help states improve their alternate tests are under way, but 鈥渢he states are kind of leading the researchers right now,鈥� said Rachel Quenemoen, a senior research fellow at the federally financed National Center on Educational Outcomes, based at the University of Minnesota-Twin Cities.
鈥淢ost states don鈥檛 do their general assessments as well as they would like, and we鈥檝e been doing general assessments for a hundred years,鈥� said Scott Marion, the associate director of the Center for Assessment, a Dover, N.H.-based group that works with states to improve their accountability systems. 鈥淲e knew that states were going to struggle with this, but we think it鈥檚 important.鈥�
The states all were informed over the summer of the results of the federal reviews of their testing systems in general, of which alternate assessments are only one part. The evaluations were based in part on the recommendations of teams of standards and testing experts, called peer reviewers.
The Education Department notified 10 states that it intends to withhold a portion of their state administrative funds under the No Child Left Behind law for failing to comply fully with the general testing provisions of the law by the end of the 2005-06 school year. Those funds would instead be sent directly to school districts.
Twenty-five other states, as well as the District of Columbia and Puerto Rico, could also have a portion of their aid withheld if they don鈥檛 fix their testing systems by the end of the 2006-07 school year.
Saying that a valid assessment system is a 鈥渓inchpin鈥� of the No Child Left Behind law, the Education Department plans to offer several opportunities for states to have their assessment programs reviewed again, said a Sept. 19 letter to chief state school officers from Henry L. Johnson, the assistant secretary for elementary and secondary education.
Great Expectations
The peer-review process for the alternate assessments offered its own difficulties, said William D. Schafer, a professor emeritus at the University of Maryland College Park, who was a federal peer reviewer and helped devise Maryland鈥檚 alternate assessments.
鈥淵ou have a certain lack of standardization,鈥� Mr. Schafer said. 鈥淣ot all kids are presented with the same tasks. Therefore, without standardization, you can鈥檛 use some of the typical tools in order to evaluate technical adequacy.鈥�
But, on the positive side, many educators say that students who were once considered to have dim prospects for academic progress are proving that, with the right instruction, they can learn at higher-than-expected levels.
鈥淭his group of kids can achieve in academic ways that we never believed possible,鈥� Ms. Quenemoen said.
The alternate assessments have also prompted a major shift in how teachers of students with significant cognitive disabilities teach them, said Elizabeth Bermensolo Compton, a regional consultant to the Idaho Department of Education. She helped develop that state鈥檚 alternate assessments.
Idaho鈥檚 tests rely on teachers to observe students over four to eight weeks and to measure each student鈥檚 skill level under a standard scoring guide.
鈥淭eachers have to know about their particular assessment, and from that be able to look at their instruction in the classroom,鈥� Ms. Compton said.
Misty Kimbrough, the assistant state supervisor for special education services for the Oklahoma Department of Education, said the tests also help teachers communicate with parents in a new and deeper way. Oklahoma鈥檚 testing system was one of four that the federal Education Department gave its full approval.
Before the tests, 鈥測ou struggled with how to report the successes a child had, and there were successes,鈥� Ms. Kimbrough said. 鈥淭his opens the doors of communication.鈥�
