So-called 鈥渂rain training鈥� programs designed to help boost students鈥� attention and working memory are coming under scrutiny from the Federal Trade Commission, as some claims have outpaced both the initial hopes and subsequent evidence.
Last year, the FTC declared open season on brain-training programs, both those directed at classrooms and for general public use. Last month, it announced a $2 million settlement and $50 million judgement for misleading advertising against Lumos Labs Inc., the creators of Lumosity, a suite of computer- and app-based brain-training programs. A judge found that the company鈥檚 in-house research did not prove its video games could 鈥渋mprove school, work, and athletic performance鈥� or protect against cognitive impairments caused by attention deficit disorders, traumatic brain injury, pediatric chemotherapy, or adult dementia as its advertisements had claimed.
Earlier in the year, the FTC also settled with the Texas-based Focus Education, which inappropriately claimed its Jungle Rangers computer game had 鈥渟cientifically proven memory- and attention-training exercises鈥� that give students 鈥渢he ability to focus, complete school work, homework, and to stay on task.鈥�
The Every Student Succeeds Act has created a tiered evidence structure to help states and districts evaluate programs鈥� effectiveness in nascent research areas like memory training, but actions against Lumosity and Jungle Rangers give warning to researchers and educators alike that the promise of some interventions can turn into hype.
鈥淲e are hoping to crack down on overhyped claims in this area,鈥� said Michelle Rusk, a lawyer in the FTC鈥檚 bureau of consumer protection. 鈥淲e may in the next year or two be bringing other cases for similar kinds of brain training for children.鈥�
Booming Industry
Lumosity is one of the best-known of a slew of new app- and computer-based programs intended to help students improve working memory, the system the brain uses to hold information during decisionmaking and analysis.
Working-memory capacity naturally expands as a child grows鈥�12-year-olds can handle about twice as many individual pieces of information as 7-year-olds, for example. In the early 2000s, neuroscientists and cognitive psychologists studying neuroplasticity found evidence to suggest working-memory capacity could be expanded in other ways, too.
鈥淥riginally, we were really excited about this; we found what we thought was [learning] transfer to other tasks,鈥� said Michael Dougherty, a professor of psychology and the director of the Decision, Attention, and Memory Lab at the University of Maryland, College Park. He was one of the 鈥渙ptimists in the field,鈥� he said, but did not work on projects for Lumos Labs or Focus Education.
Annual sales of brain-training products in the United States and Canada climbed past $67 million last year, according to a recent analysis by MarketsandMarkets, a private business research group.
Worldwide sales of such products were more than three times higher, approaching $227 million.
SOURCE: MarketsandMarkets
鈥淭he claims of scientists and the claims of companies鈥擨 don鈥檛 think they differ too much, unfortunately,鈥� Dougherty said. 鈥淚 think these initial promising results were taken to mean there were very strong cognitive results and changing [those indicators] could change your life.鈥�
Since 2013, the business research firm MarketsandMarkets estimates the 鈥渂rain training鈥� market has grown from $48.5 million in annual revenues to more than $67 million in North America alone, and it is projected to grow to nearly $200 million by 2020. Worldwide, the market could top $700 million, it says.
Lumos Labs declined to comment for this story, but its advertisements said outright: 鈥淏rain training has the potential to change lives.鈥� Through the Lumosity Education Access Program, Lumos Labs provided free copies of the games to students in more than 500 schools, in part to help build a research base to prove the interventions鈥� effectiveness. The company also built up a network of researchers, dubbed the Human Cognition Project, to dig through the data, and presented its research at conferences such as the Society for Neuroscience.
Research Rules
In FTC documents, investigators noted Lumosity offers 40 different games that purported to target specific brain areas, using 10- to 15-minute sessions several days a week (at costs ranging from $14.95 a month to nearly $300 for a lifetime subscription). Advertisements pointed to studies that suggested the training could improve students鈥� math skills, including for girls with Turner syndrome, a genetic disorder that can result in cognitive impairments, particularly in math. Advertisements also noted a study of more than 1,200 students in 40 schools. Those who used Lumosity to supplement their regular curriculum, the advertisement said, 鈥渋mproved more than a control group on a battery of cognitive assessments.鈥�
That鈥檚 true, as far as it goes. But Lumosity鈥檚 studies and many others across the brain-training field had increasing problems showing that the improvements in scores on their games actually transferred to better learning, memory, and attention beyond them.
鈥淟umosity generated millions and millions in sales and spent millions and millions in marketing, so they clearly had the money to do a couple of high-quality studies,鈥� Rusk said. 鈥淭he best way to stay on the right side of the law is to be very careful not to get ahead of where the science is.鈥�
Eric B. Gordon, the president and CEO of Atentiv, another cognitive-improvement program, did not comment on the FTC鈥檚 settlements but said his own company has been building up evidence on Atentiv using clinical, home, and school studies, and that any communications on its programs goes through 鈥渋ndependent scientific and regulatory approval鈥� before being released.
鈥淥nly good practices deliver valuable and viable health-care solutions. Evidence comes first,鈥� he said.
But big, generalizable cognitive improvements have been much harder to come by than researchers and educators initially hoped.
In a 2013 meta-analysis in the journal Developmental Psychology, researchers at the University of Oslo, Norway, looked at 23 studies on working-memory training. They found many programs did improve short-term working-memory skills, but the improvements were not sustained, and the skills did not translate into more general cognitive skills associated with working memory, such as attention control, verbal and nonverbal ability, or word decoding.
In the same year, Thomas Redick and colleagues at the Purdue University Applied Cognition Lab found no evidence of improvement in general cognition after 20 sessions of a working-memory training program that used a structure that is similar to many games: the 鈥淣-Back test.鈥� The most basic form of the task requires a student to remember a target, such as a number or word, which appears in a series, while dealing with distractions.
Finding Broader Learning
Dougherty found similar problems in his own experiments: 69传媒 and adults regularly improved in speed and accuracy on training tasks like these, but the further the task was from complex, real-life attention and decisionmaking, the less those benefits transferred.
鈥淚t would be great if we could move everybody鈥檚 IQ by 2 or 3 points鈥攊t would be amazing,鈥� Dougherty said, 鈥渁nd I was very optimistic, and then in study after study, both in my own labs and other people鈥檚, we just didn鈥檛 find it.鈥�
In 2014, the Stanford University Center on Longevity and Germany鈥檚 Max Planck Institute for Human Development convened international cognitive psychologists and neuroscientists to hash out a consensus on the state of evidence on brain training, which was blunt: 鈥淐laims promoting brain games are frequently exaggerated and at times misleading. ... To date, there is little evidence that playing brain games improves underlying broad cognitive abilities, or that it enables one to better navigate a complex realm of everyday life.鈥�
An intervention that meets ESSA鈥檚 rules for research evidence on some level could still include claims on promotional materials that run afoul of the FTC鈥檚 rules, which are based on the federal Unfair Claims Act and are more black-and-white than the new education research requirements. The agency can consider a claim misleading if it doesn鈥檛 rely on 鈥渃ompetent and reliable scientific evidence,鈥� based on 鈥渉uman clinical testing ... randomized, double-blind, and adequately controlled; and conducted by researchers qualified by training and experience to conduct such testing.鈥� That鈥檚 roughly equivalent to ESSA鈥檚 top tier of evidence, but the education law lays out lower tiers which states can choose to use鈥攑articularly in areas of nascent research.
Rusk of the FTC said the agency would continue its investigations, but warned school leaders to scrutinize any program claiming to improve students鈥� intelligence or attention. 鈥淭he more dramatic the improvements promised, the more skeptical they should be,鈥� she said. 鈥淚t is the case unfortunately that we have to go after these companies one at a time, and we don鈥檛 have the resources to investigate every product on the market, so it does require some due diligence on the part of the educator.鈥�
The scientists who developed the Stanford-Planck consensus statement recommended that future cognitive research on brain training also examine 鈥渙pportunity costs ... If an hour spent doing solo software drills is an hour not spent hiking, learning Italian, making a new recipe or playing with your grandchildren, it may not be worth it.鈥�
They and Dougherty also noted that the one activity so far that has been shown to have some improvement on general cognition is physical exercise鈥攖he opposite of sitting in front of a computer screen or app.
