© Monkey Business, Adobe Stock
<h1 class="legacy">Australia has its first framework for AI use in schools – but we need to proceed with caution</h1>
<p><a href="https://theconversation.com/profiles/lucinda-mcknight-324350">Lucinda McKnight</a>, <em><a href="https://theconversation.com/institutions/deakin-university-757">Deakin University</a></em> and <a href="https://theconversation.com/profiles/leon-furze-1405737">Leon Furze</a>, <em><a href="https://theconversation.com/institutions/deakin-university-757">Deakin University</a></em></p>
<p>Federal and state governments have just released a <a href="https://www.education.gov.au/schooling/resources/australian-framework-generative-artificial-intelligence-ai-schools">national framework</a> for generative AI in schools. This paves the way for <a href="https://www.mckinsey.com/featured-insights/mckinsey-explainers/what-is-generative-ai">generative AI</a> – algorithms that can create new content – to be used routinely in classrooms around the country.</p>
<p>This provides much-needed guidance, a full year after the launch of ChatGPT. Over the past 12 months, schools have had a <a href="https://theconversation.com/high-school-students-are-using-a-chatgpt-style-app-in-an-australia-first-trial-209215">range of responses</a> to the technology from outright banning to trying to incorporate it into learning.</p>
<p>What is in the framework and what is missing?</p>
<h2>What is the framework?</h2>
<p>The framework was agreed by state and federal education ministers in October and released publicly last week.</p>
<p>It is designed to help schools use generative AI “in a safe and effective way”. It notes it has “great potential to assist teaching and learning and reduce administrative workload in Australian schools”. But at the same time it warns of risk and consequences, including</p>
<blockquote>
<p>the potential for errors and algorithmic bias in generative AI content; the misuse of personal or confidential information; and the use of generative AI for inappropriate purposes, such as to discriminate against individuals or groups, or to undermine the integrity of student assessments.</p>
</blockquote>
<p>Federal Education Minister Jason Clare also stressed “schools should not use generative AI products that sell student data”.</p>
<h2>What is in the framework?</h2>
<p>The framework itself is just two pages long, and includes six overarching principles and 25 “guiding statements”. The six principles are:</p>
<ul>
<li>
<p><strong>teaching and learning</strong>, including schools teaching students about how these tools work, including their potential limitations and biases</p>
</li>
<li>
<p><strong>human and social wellbeing</strong>, including using tools in a way that avoids reinforcing biases</p>
</li>
<li>
<p><strong>transparency</strong>, including disclosing when tools are used and their impact</p>
</li>
<li>
<p><strong>fairness</strong>, including access for people from diverse and disadvantaged backgrounds</p>
</li>
<li>
<p><strong>accountability</strong>, including schools testing tools before they use them, and</p>
</li>
<li>
<p><strong>privacy, security and safety</strong>, including the use of “robust” cyber-security measures.</p>
</li>
</ul>
<p>The framework will be reviewed every 12 months.</p>
<h2>Caution is needed</h2>
<p>The framework does important work acknowledging opportunities of this technology, while noting the importance of wellbeing, privacy, security and safety.</p>
<p>However, some of these concepts are much less straightforward than the framework suggests. As experts in generative AI in education, we have moved from optimism to a much more cautious stance about this technology over the past 12 months. As UNESCO has <a href="https://unesdoc.unesco.org/ark:/48223/pf0000385877">recently warned</a>,</p>
<blockquote>
<p>the speed at which generative AI technologies are being integrated into education systems in the absence of checks, rules or regulations, is astonishing.</p>
</blockquote>
<p>The framework puts an extraordinary onus on schools and teachers to do high-stakes work for which they may not be qualified or do not have time or funding to complete.</p>
<p>For example, the framework calls for “explainability” – but even the developers of AI models struggle to <a href="https://www.nature.com/articles/d41586-023-02366-2">fully explain</a> how they work.</p>
<p>The framework also calls on schools to do <a href="https://www.businessofgovernment.org/sites/default/files/Algorithmic%20Auditing.pdf">risk assessments of algorithms</a>, design appropriate learning experiences, revise assessments, consult with communities, learn about and apply intellectual property rights and copyright law and generally become expert in the use of generative AI.</p>
<p>It is not clear how this can possibly be achieved within existing workloads, which we know are <a href="https://www.abc.net.au/news/2022-10-17/teachers-overworked-as-leson-planning-demands-bite/101536544">already stretched</a>. This is particularly so when the <a href="https://bera-journals.onlinelibrary.wiley.com/doi/10.1111/bjet.13337">nature</a> and ethics of generative AI are complex and <a href="https://cmci.colorado.edu/idlab/assets/bibliography/pdf/Raji-pedagogy2021.pdf">contested</a>. We also know the technology is not foolproof – it <a href="https://www.ibm.com/topics/ai-hallucinations#:%7E:text=AI%20hallucination%20is%20a%20phenomenon,are%20nonsensical%20or%20altogether%20inaccurate.">makes mistakes</a>.</p>
<p>Here are five areas we think need to be included in any further version of this framework.</p>
<figure id="attachment_8024" aria-describedby="caption-attachment-8024" style="width: 1000px" class="wp-caption alignnone"><img class="wp-image-8024 size-full" src="https://www.school-news.com.au/wp-content/uploads/2017/06/AdobeStock_115860529.jpg" alt="students using computer" width="1000" height="667" /><figcaption id="caption-attachment-8024" class="wp-caption-text">© highwaystarz, Adobe Stock</figcaption></figure>
<p><strong>1. A more honest stance on generative AI</strong></p>
<p>We need to be clear that generative AI is biased. This is because it reflects the <a href="https://dl.acm.org/doi/pdf/10.1145/3442188.3445922">biases of its training materials</a>, including what is published on the internet.</p>
<p>Such limited datasets are created largely by those who are <a href="https://www.bloomberg.com/graphics/2023-generative-ai-bias/">white, male and United States or Western-based</a>.</p>
<p>For example, a current version of ChatGPT does not speak in or use Australian First Nations words. There may be valid reasons for this, such as not using cultural knowledges without permission. But this indicates the whiteness of its “voice” and the problems inherent in requiring students to use or rely on it.</p>
<p><strong>2. More evidence</strong></p>
<p>The use of technology does not automatically improve teaching and learning.</p>
<p>So far, there is little research demonstrating the benefits of generative AI use in education. In fact, (<a href="https://www.unesco.org/gem-report/en/technology">a recent UNESCO report</a> confirmed there is little evidence of any improvement to learning from the use of digital technology in classrooms over decades.</p>
<p>But we do have research showing the the harms of algorithms. For example, <a href="https://www.tandfonline.com/doi/abs/10.1080/17439884.2020.1667825">AI-driven feedback</a> narrows the kinds of writing students produce and privileges white voices.</p>
<p>Schools need support to develop processes and procedures to monitor and evaluate the use of generative AI by both staff and students.</p>
<p><strong>3. Acknowledging dangers around bots</strong></p>
<p>There is <a href="https://dl.acm.org/doi/pdf/10.1145/365153.365168">long-standing research</a> demonstrating the dangers of chatbots and their capacity to harm human creativity and critical thinking. This happens because humans seem to automatically trust bots and their outputs.</p>
<p>The framework should aim to clarify which (low-stakes) tasks are and are not suitable for generative AI for both students and teachers. High stakes marking, for example, should be completed by humans.</p>
<p><strong>4. Transparency</strong></p>
<p>So far, the framework seems to focus on students and their activities,</p>
<p>All use of generative AI in schools needs to be disclosed. This should include teachers using generative AI to prepare teaching materials and plan lessons.</p>
<p><strong>5. Acknowledging teachers’ expertise</strong></p>
<p>The global education technology (“edtech”) market was estimated to be worth about <a href="https://www.holoniq.com/notes/2022-global-education-outlook">US$300 billion</a> (A$450 billion) as of 2022. Some companies <a href="https://www.theaustralian.com.au/higher-education/solve-school-decline-with-technology-says-richard-white/news-story/35233b2510956d4b7e1a8fcaee846d93">argue</a> edtech can be used to monitor students’ progress and take over roles traditionally done by teachers.</p>
<p>Australia’s national education policies need to ensure teachers’ roles are not downgraded as AI use becomes more common. Teachers are experts in more than just subject matter. They are experts in how to teach various disciplines and in their students’ and communities’ needs. <!-- Below is The Conversation's page counter tag. Please DO NOT REMOVE. --><img style="border: none !important; box-shadow: none !important; margin: 0 !important; max-height: 1px !important; max-width: 1px !important; min-height: 1px !important; min-width: 1px !important; opacity: 0 !important; outline: none !important; padding: 0 !important;" src="https://counter.theconversation.com/content/219094/count.gif?distributor=republish-lightbox-basic" alt="The Conversation" width="1" height="1" /><!-- End of code. If you don't see any code above, please get new code from the Advanced tab after you click the republish button. The page counter does not collect any personal data. More info: https://theconversation.com/republishing-guidelines --></p>
<p><a href="https://theconversation.com/profiles/lucinda-mcknight-324350">Lucinda McKnight</a>, Senior Lecturer in Pedagogy and Curriculum, <em><a href="https://theconversation.com/institutions/deakin-university-757">Deakin University</a></em> and <a href="https://theconversation.com/profiles/leon-furze-1405737">Leon Furze</a>, PhD Candidate, <em><a href="https://theconversation.com/institutions/deakin-university-757">Deakin University</a></em></p>
<p>This article is republished from <a href="https://theconversation.com">The Conversation</a> under a Creative Commons license. Read the <a href="https://theconversation.com/australia-has-its-first-framework-for-ai-use-in-schools-but-we-need-to-proceed-with-caution-219094">original article</a>.</p>

The Indigenous Literacy Foundation (ILF) has announced that in 2025 Busking for Change is being…
About one quarter of Australian school students are learning English as an additional language or…
Spending time in green spaces reduces cortisol levels, lowers heart rate, and positively impacts mood…
Social isolation, loneliness, bullying, and family breakdowns are now key causes of distress among young…
Busy, high-use areas, washrooms can use some extra attention to make sure students feel comfortable…
A study investigating the realities of out-of-field teachers is seeking participants for groundbreaking research.
This website uses cookies.