© Lincoln - stock.adobe.com
<h1 class="theconversation-article-title">Deepfake AI pornography is becoming more common – what can parents and schools do to prevent it?</h1>
<div class="theconversation-article-body"><a href="https://theconversation.com/profiles/gabrielle-hunt-1497230">Gabrielle Hunt</a>, <em><a href="https://theconversation.com/institutions/australian-catholic-university-747">Australian Catholic University</a></em> and <a href="https://theconversation.com/profiles/daryl-higgins-355954">Daryl Higgins</a>, <em><a href="https://theconversation.com/institutions/australian-catholic-university-747">Australian Catholic University</a></em></p>
<p>A Victorian school community is <a href="https://www.abc.net.au/news/2024-06-12/bacchus-marsh-ai-images-fake-nude-students-photo-online/103967402">reeling</a> after fake, sexually explicit images of female students were generated using artificial intelligence and then shared on social media.</p>
<p><a href="https://www.school-news.com.au/latest-print-issue/" target="_blank" rel="noopener"><strong>Read the latest print edition of <em>School News</em> HERE</strong></a></p>
<p>About 50 high school students at Bacchus Marsh Grammar had their images altered. A teenage boy has been arrested and released pending further inquiries. Parents have <a href="https://www.abc.net.au/news/2024-06-12/bacchus-marsh-ai-images-fake-nude-students-photo-online/103967402">described</a> the images as “incredibly graphic” and “sickening”.</p>
<p>Unfortunately this is not an isolated case. Last month, a Victorian high school student was expelled after he used AI to generate sexually explicit <a href="https://www.heraldsun.com.au/subscribe/news/1/?sourceCode=HSWEB_WRE170_a_GGL&;dest=https%3A%2F%2Fwww.heraldsun.com.au%2Fvictoria-education%2Fsalesian-college-student-suspended-after-producing-explicit-images-of-female-teacher-using-ai%2Fnews-story%2Fd4b1a77eb5710e8f4ba39abb24f1dfe5&;memtype=registered&;mode=premium&;v21=HIGH-Segment-1-SCORE">images of a teacher</a>. This comes amid warnings AI is leading to an <a href="https://x.com/7NewsMelbourne/status/1718860342686871842">increase in sextortion reports</a>.</p>
<p>It also follows multiple cases where males students have used misogynistic and derogatory language about female peers, including <a href="https://www.news.com.au/lifestyle/parenting/school-life/alumni-start-petition-to-have-male-students-behind-unrapeable-list-expelled/news-story/3fbb109636c249f6f995ae0c3c6531b6">a spreadsheet</a> to rank students from “wifey” to “unrapeable”.</p>
<p>Our research shows it is not unusual for young people to harass and abuse their peers. So how can parents and schools respond?</p>
<h2>Just because it’s AI does not mean it is OK</h2>
<p>Sharing sexually explicit images of children (those under 18) and sharing them without consent (no matter how old someone is) is image-based abuse – even if AI has been used or the images have been altered in some way.</p>
<p>As the <a href="https://www.esafety.gov.au/key-topics/image-based-abuse#:%7E:text=Image%2Dbased%20abuse%20%E2%80%93%20sometimes%20called,a%20person%20without%20their%20consent.">eSafety commissioner explains</a>, it is still abuse if the image or video is:</p>
<blockquote>
<p>altered or faked to look like you [or] shared in a way that makes people think it’s you, even when it’s not (such as a nude of someone else tagged with your name).</p>
</blockquote>
<p>As the commissioner also explains, there are criminal laws that cover this abuse and police may be able to investigate. Last week, the federal government also <a href="https://www.theguardian.com/australia-news/article/2024/jun/01/creating-or-sharing-deepfake-porn-without-consent-to-be-under-proposed-new-australian-laws">introduced new laws</a> to parliament to strengthen protections against “deepfakes” (using AI to generate a false depiction of a real person).</p>
<p>But apart from the legal issues, this abuse is also highly damaging and distressing for those involved.</p>
<p>A <a href="https://fsi.stanford.edu/news/investigation-finds-ai-image-generation-models-trained-child-abuse">2023 investigation</a> by the Stanford Internet Observatory found some AI models are using a database of existing child sexual abuse material to generate new images. This means there are real children being exploited to generate sexually explicit images of more children.</p>
<h2>What does the research say?</h2>
<p>Research <a href="https://journals.sagepub.com/doi/10.1177/1089268020954363">clearly shows</a> sexual abuse and harassment is a gendered issue. Women, girls and gender diverse individuals are disproportionately affected. And men and boys are overwhelmingly more likely to perpetrate these crimes.</p>
<p>The <a href="https://www.acms.au/">Australian Child Maltreatment Study</a> has found adolescents also make up a substantial proportion of perpetrators of child sexual abuse and sexual harassment. The results, collected in 2021, also showed this has increased over time.</p>
<p>Overall, <a href="https://www.sciencedirect.com/science/article/pii/S0145213423005501?via%3Dihub">18.2% of participants</a> aged 16–24 reported being sexually abused by an adolescent during their childhood, compared to 12.1% of those aged 45 years and over.</p>
<p>More than 15% of women and 24% of gender diverse participants aged 16 and over <a href="https://journals.sagepub.com/doi/full/10.1177/08862605241245368">reported</a> being sexually harassed by an adolescent during their childhood, compared to 5% of men.</p>
<p>For more than 90% of people who experienced peer sexual harassment, it was inflicted by a male peer.</p>
<h2>Why is this happening?</h2>
<p>As our research indicates, we have a cultural problem with gender-based violence in Australia.</p>
<p>The ease of access to pornography and technology such as AI have likely made this problem worse. Exposure to pornography, including violent content, is happening from a young age. A 2024 <a href="https://www.sciencedirect.com/science/article/pii/S1326020024000104?via%3Dihub">Australian study</a> showed more than 52% of men and 32% of women had reported viewing pornography by age 14.</p>
<p>Viewing pornography is associated with the <a href="https://onlinelibrary.wiley.com/doi/abs/10.1111/j.1460-2466.2009.01422.x">sexual objectification of women</a>. Intentionally viewing violent X-rated material is also associated with a significant increase in the likelihood of <a href="https://onlinelibrary.wiley.com/doi/abs/10.1002/ab.20367">sexually aggressive behaviour</a>.</p>
<h2>What can we do about it?</h2>
<p>While one part of the solution may come from <a href="https://www.theguardian.com/australia-news/article/2024/may/03/australia-porn-age-verification-technology-government">age verification technology</a> for adult websites, research also <a href="https://onlinelibrary.wiley.com/doi/10.1002/car.2859">shows</a> we need to take a primary prevention approach. This means trying to stop this sort of behaviour from happening in the first place.</p>
<p>This necessarily involves changing cultural norms around violence and gender with all young people. Parents and schools are key.</p>
<h2>What can parents do?</h2>
<p>Parents need to make space for their children to talk about tricky and concerning things. You can do this by:</p>
<p><strong>1. Talking early</strong></p>
<p>Help your child feel comfortable about talking to you by starting conversations early. Conversations about bodily autonomy and boundaries can start in primary school. As your child grows, <a href="https://kidshelpline.com.au/parents">conversations</a> about consent, healthy relationships, porn and sexting can also start. Listen to what your child has to say.</p>
<p><strong>2. Making the conversations regular</strong></p>
<p>We can’t expect children to welcome or respond well to parents’ questions the first time or every time. So keep conversations <a href="https://www.childsafety.gov.au/one-talk-time">short and regular</a>. Be guided by your child.</p>
<p><strong>3. Acting on concerns</strong></p>
<p>Stay calm, talk to and listen to your child. Focus on their wellbeing by asking how they are feeling and what you can do to support them. Also look for signs they might need further support, such as talking to their school, police or <a href="https://www.esafety.gov.au/report#:%7E:text=What%20you%20can%20report%20to,and%20illegal%20and%20restricted%20content.">making a report</a> to the eSafety Commission.</p>
<h2>What should schools do?</h2>
<p>Schools are also a significant part of the community’s response. Research <a href="https://www.whatworks.co.za/documents/publications/374-evidence-reviewfweb/file">shows</a> school programs aimed at addressing sexual violence and cultural norms around gender can be effective. Some things schools can do include:</p>
<p><strong>1. Providing training and resources for staff</strong></p>
<p>Staff need clear policies and procedures on how to <a href="https://www.esafety.gov.au/educators/toolkit-for-schools/respond">respond effectively</a> and <a href="https://aifs.gov.au/resources/resource-sheets/mandatory-reporting-child-abuse-and-neglect">report to the relevant authorities</a> when there is sexual harassment, assault or child abuse.</p>
<p><strong>2. Comprehensive sex education for students</strong></p>
<p>Research <a href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6283686/">shows</a> sex education can help prevent harmful behaviours by teaching children and young people about healthy relationships, boundaries and informed and enthusiastic consent. This education needs to include consideration of pornography, sexting and online safety.</p>
<p><strong>3. Providing strong school leadership</strong></p>
<p>Leaders are responsible for the culture and practices of their schools. They need to take a zero-tolerance approach to anything that normalises stereotyping, degrading comments, violence or misogyny. Children in a school should be empowered to raise concerns to adults and know they will be listened to and believed.</p>
<hr />
<p><em>If this article has raised issues for you, or if you’re concerned about someone you know, call <a href="https://www.1800respect.org.au">1800RESPECT</a> on 1800 737 732 or visit the eSafety Commissioner’s <a href="https://www.esafety.gov.au">website</a> for help with image-based abuse.</em><!-- Below is The Conversation's page counter tag. Please DO NOT REMOVE. --><img style="border: none !important; box-shadow: none !important; margin: 0 !important; max-height: 1px !important; max-width: 1px !important; min-height: 1px !important; min-width: 1px !important; opacity: 0 !important; outline: none !important; padding: 0 !important;" src="https://counter.theconversation.com/content/232248/count.gif?distributor=republish-lightbox-basic" alt="The Conversation" width="1" height="1" /><!-- End of code. If you don't see any code above, please get new code from the Advanced tab after you click the republish button. The page counter does not collect any personal data. More info: https://theconversation.com/republishing-guidelines --></p>
<p><a href="https://theconversation.com/profiles/gabrielle-hunt-1497230">Gabrielle Hunt</a>, PhD Candidate, <em><a href="https://theconversation.com/institutions/australian-catholic-university-747">Australian Catholic University</a></em> and <a href="https://theconversation.com/profiles/daryl-higgins-355954">Daryl Higgins</a>, Professor &; Director, Institute of Child Protection Studies, <em><a href="https://theconversation.com/institutions/australian-catholic-university-747">Australian Catholic University</a></em></p>
<p>This article is republished from <a href="https://theconversation.com">The Conversation</a> under a Creative Commons license. Read the <a href="https://theconversation.com/deepfake-ai-pornography-is-becoming-more-common-what-can-parents-and-schools-do-to-prevent-it-232248">original article</a>.</p>
</div>

A study investigating the realities of out-of-field teachers is seeking participants for groundbreaking research.
The resources are designed to support teachers to make sure all students are engaged in…
Tic disorders are far more common than many people realise, and are often misrepresented in…
The school library has long been a place of discovery, reflection, and learning. But as…
Is your school an inclusive community that empowers students to recognise bullying and to stand…
Performance indicators for the education and VET sectors have just been released with some encouraging…
This website uses cookies.