The K-12 education system is awash in data as never before. But if all that information is going to add up to anything, then computerized school data systems need to become much more accessible to educators in the trenches.
That message was among the themes to emerge from a conference here this month for architects of K-12 data systems from the public and private sectors. The conference, billed as Data Systems and Instructional Improvement: There Is Much More to Do!, brought together state and district administrators, university researchers, and company leaders to discuss how the rising tide of digital data can be used to improve classroom instruction.
If test results and other student information are available for analysis through easy-to-use data tools, they can improve everything from identifying individual students鈥 learning needs to allocating schoolwide resources, said conference keynote speaker Jeffrey C. Wayman, a researcher from Johns Hopkins University鈥檚 Center for Social Organization of 69传媒.
But too often, he said, such data languish in central repositories, used for little but accountability reporting.
鈥淒ata have been like a roach motel,鈥 he said. 鈥淒ata check in, they just don鈥檛 check out.鈥
The Dec. 1-2 conference comes amid a proliferation of data spurred by the federal No Child Left Behind Act. States have had to institute complex, test-based accountability systems as part of carrying out the law鈥檚 mandates on raising student achievement.
The federally funded North Central Regional Educational Laboratory, whose work is conducted by the nonprofit Learning Point Associates of Naperville, Ill., sponsored the gathering.
With the push to meet NCLB mandates, the lines are blurring between the three main types of school data systems in use, Mr. Wayman said.
He defines those as student-information systems, which tend to feature only current-year data and are used for day-to-day tasks such as attendance and scheduling; assessment systems used for rapid scoring of periodic, locally administered tests; and data warehouses, which typically are used for storing and analyzing multiyear data, but not for collecting and managing them on a daily basis.
Yet even though more-integrated systems are emerging, he said, 鈥渨e don鈥檛 have one killer system that does everything.鈥
Mr. Wayman and other participants stressed that most educators lack the know-how to make use of contemporary data-analysis tools. 鈥淪ystem capacity far outweighs educator capacity, and that gap is growing,鈥 he said.
Anthony Evers, Wisconsin鈥檚 deputy superintendent of public instruction, blamed at least some of that gap on the No Child Left Behind Act.
Since the law鈥檚 enactment, he said, his state has had to rebuild its technology infrastructure to comply with the statute鈥檚 reporting demands, diverting resources from what had been its top educational technology priority: training teachers to use computers in the classroom.
鈥淣CLB came along and hijacked that effort,鈥 Mr. Evers said. 鈥淎nd if we don鈥檛 return to that, we鈥檒l be in trouble.鈥
Other educators suggested that the federal law has been a boon to data-driven decisionmaking, or D3M for short. 鈥淣o Child Left Behind has been a great thing for data analysis,鈥 said David M. Chiszar, the director of assessment for Illinois鈥 19,000-student Naperville School District 203.
Arie van der Ploeg, a senior researcher at Learning Point Associates, agreed that the law was generally 鈥渁 good thing鈥 that is generating 鈥渁 lot of intelligence about data.鈥 Yet the field has a long way to go, he stressed, before systems capture such data as 鈥渨hat individual teachers do well or not鈥 and then act on the information consistently to improve teaching and learning.
One purpose of the conference was to let public school officials trade notes with private vendors over how to get more out of big-ticket data initiatives.
Leo Bohman, the vice president of applications development at SPSS Inc., a Chicago-based provider of data-analysis software and services, urged educators to do their homework by clarifying their needs before issuing requests for proposals from vendors.
鈥淚 can鈥檛 respond very effectively with an RFP saying, 鈥楬ere鈥檚 all the data we have, tell me what you can do,鈥 鈥 he said.
Mark Williams, the president of Executive Intelligence Inc., based in Lakewood, Colo., said the data-integration company had worked to get one district鈥檚 information out of 鈥渄ata jail,鈥 only to have the information end up in 鈥渁dministrator jail,鈥 never to be seen or used by teachers.
鈥淚t was disappointing for us,鈥 Mr. Williams said. 鈥淭heir goal was not to improve their district; it was to appear to improve their district.鈥
While acknowledging the need for schools to make better use of evolving data-analysis tools, educators cautioned that systems designers must not forget the human element.
鈥淗opefully, that鈥檚 been my part of it,鈥 said Jim Walters, the principal of the 500-student Bayless Intermediate School in the St. Louis suburb of Bayless, Mo., 鈥渢o remind them that if they don鈥檛 involve the teachers and the community, it isn鈥檛 going to work.鈥