American Students are increasingly using generative AI to create inappropriate images and videos–known as deepfake non-consensual intimate images (NCII)–of young girls in the K-12 school system (Walker, 2025). To date, schools do not have clear guidelines on how to handle this rising crisis. Federal policy attention, such as the Take It Down Act, prioritizes removing the harmful content after it is put online, as opposed to taking steps to prevent deepfake NCII from being created. It is time to readjust how generative AI content is regulated. This brief examines different international approaches to mitigating the risk of AI violence against women, such as the AI Act and Digital Services Act (DSA), to propose preventative measures within U.S. policy. Preventing deepfake NCII from circulating schools would include the following: mandating that the NIST AI Risk Management Framework be adopted by all generative AI companies operating within the United States; defining AI deepfake NCII as a form of abuse; establishing rules stating what minors can access on the internet as well as creating safe, protected spaces for them to responsibly use the internet; implementing mandated free training for school teachers and administrations across the country about what constitutes proper AI usage and how to prevent AI-based violence; designing lessons for school-age children about the harm of deepfake NCII; expanding counseling services within public schools to assist children who are affected by deepfake NCII.
Keira Giacometti· Zenodo (CERN European Organi...· 0 citations
American Students are increasingly using generative AI to create inappropriate images and videos–known as deepfake non-consensual intimate images (NCII)–of young girls in the K-12 school system (Walker, 2025). To date, schools do not have clear guidelines on how to handle this rising crisis. Federal policy attention, such as the Take It Down Act, prioritizes removing the harmful content after it is put online, as opposed to taking steps to prevent deepfake NCII from being created. It is time to readjust how generative AI content is regulated. This brief examines different international approaches to mitigating the risk of AI violence against women, such as the AI Act and Digital Services Act (DSA), to propose preventative measures within U.S. policy. Preventing deepfake NCII from circulating schools would include the following: mandating that the NIST AI Risk Management Framework be adopted by all generative AI companies operating within the United States; defining AI deepfake NCII as a form of abuse; establishing rules stating what minors can access on the internet as well as creating safe, protected spaces for them to responsibly use the internet; implementing mandated free training for school teachers and administrations across the country about what constitutes proper AI usage and how to prevent AI-based violence; designing lessons for school-age children about the harm of deepfake NCII; expanding counseling services within public schools to assist children who are affected by deepfake NCII.
Keira Giacometti· Zenodo (CERN European Organi...· 0 citations
