69传媒 are falling short in meeting the rising threat of artificial intelligence-enabled sexual harassment, concludes , a nonprofit that advocates for online civil liberties.
Forty percent of students and 29 percent of teachers say they know of a 鈥渄eepfake鈥� depicting individuals associated with their school being shared during the 2023-24 school year, according to the nationally representative survey of high school students, middle and high school teachers, and parents. (A deepfake is a digitally-manipulated video, photo, or audio recording created using someone鈥檚 voice and/or likeness without their permission.)
The primary perpetrators鈥攁nd victims鈥攁re students, the report found.
While the act of sharing non-consensual intimate imagery is a long-standing problem in schools, the rise of generative artificial intelligence has made it easier to create and share fake intimate images, videos, or audio that seem real. In recent months, there have been several reported instances of students using AI tools to generate fake, pornographic images of their classmates and fake videos of their teachers or principals.
鈥淭he surface area for who can become a victim and who can become a perpetrator is significantly increased when anybody has access to these tools,鈥� said Kristin Woelfel, a policy counsel for the Center for Democracy & Technology and one of the authors of the report. 鈥淭here鈥檚 really no limit as to who could be impacted by this.鈥�
For those who are victims of real or deepfake non-consensual intimate images, the experience is 鈥渟cary鈥� and 鈥渢raumatic,鈥� said Anjali Verma, the National Student Council president and a senior at a charter school in West Chester, Pa. 鈥淚鈥檝e seen it happen with friends and people in my life.鈥�
69传媒, teachers, and parents report a lack of support and awareness about deepfake non-consensual intimate imagery. For instance, few students say their school has explained what deepfakes are (19 percent), how they affect those depicted (13 percent), and who to tell at the school if they see or hear about them (15 percent), the report found.
And 60 percent of teachers and 67 percent of parents surveyed say they have not heard of their school or school district sharing policies and procedures with teachers about how to address authentic or deepfake non-consensual intimate imagery.
Still, a third of students said their school does a good job of catching students who share deepfake non-consensual intimate imagery, while 1 in 10 students who have heard of such incidents at their school said the student who shared it was never caught, according to the report.
Questions to ask to help prevent future 鈥榙eepfake鈥� incidents
In the current environment, a lot of schools focus on 鈥渟evere discipline鈥� for the perpetrators, Woelfel said. Those methods might include suspension or expulsion, as well as getting law enforcement involved, she said.
The problem, Woelfel said, is that there is almost no focus on preventing the conduct in the first place and on supporting the victim after the incident.
Woelfel and Anjali acknowledged that schools need a lot of guidance from policymakers in order to have better response and prevention strategies, but they had some suggestions for where schools can start.
For prevention, Woelfel said schools need to better educate students and staff about deepfakes, asking questions such as:
- What is a deepfake?
- What is the harm of creating one?
- What are the consequences of making and sharing them?
- Who can they go to when they see or hear about these incidents?
Education and awareness shouldn鈥檛 just start at the high school level, Anjali emphasized. It should be a conversation that begins in elementary school, in age-appropriate ways.
鈥淲e have to start students very young, making sure that they鈥檙e aware of the [digital] world and the amount of power that comes with having this technology access,鈥� Anjali said.
Support for victims could include providing counseling and resources for how to get deepfakes taken down if they were posted online, Woelfel said.
It鈥檚 also important to 鈥渢ake a step back and reevaluate鈥� the school climate to ensure that students feel 鈥渆mpowered鈥� to tell an adult when something bad has happened, Anajli said.
鈥淲e have to make sure there鈥檚 an environment where students are able to come to administration about these things without the fear of being judged,鈥� she added.
The Center for Democracy & Technology survey included 1,316 9th- to 12th-grade students, 1,006 6th- to 12th-grade teachers, and 1,028 parents of 6th- to 12th-grade students. It was conducted this summer.
