OK computer: to prevent students cheating with AI text-generators, we should bring them into the classroom

<h3>Artificial intelligence-based &lpar;AI&rpar; programs are quickly improving at writing convincingly on many topics&comma; for virtually no cost&period;<&sol;h3>&NewLine;<h2>It’s likely in a few years they’ll be churning out C-grade worthy essays for students&period;<&sol;h2>&NewLine;<p>We could try to ban them&comma; but this software is highly accessible&period; It would be a losing battle&period;<&sol;p>&NewLine;<p>Long-form writing&comma; especially essay writing&comma; remains one of the best ways to teach critical analysis&period; Teachers rely on this mode of assessment to gauge students’ understanding of a topic&period;<&sol;p>&NewLine;<p>Thus&comma; we need to find ways to help students of all disciplines thrive alongside advanced automation and smart systems&comma; rather than resist them&period; This involves training students to work with AI tools&comma; rather than banning them&period;<&sol;p>&NewLine;<h2>What are AI-powered text generators&quest;<&sol;h2>&NewLine;<p>In February 2019&comma; GPT-2&comma; an AI-powered text generating system was released by <a href&equals;"https&colon;&sol;&sol;openai&period;com&sol;blog&sol;better-language-models&sol;">OpenAI<&sol;a>&period; Those interested can try the system themselves by following <a href&equals;"https&colon;&sol;&sol;minimaxir&period;com&sol;2019&sol;09&sol;howto-gpt2&sol;">these instructions<&sol;a>&comma; or experiment with <a href&equals;"https&colon;&sol;&sol;talktotransformer&period;com&sol;">Talk to Transformer<&sol;a>&comma; an online tool made using GPT-2&period;<&sol;p>&NewLine;<p>The idea behind GPT-2 is similar to the predictive text function on a smartphone&period; A machine learning system was given 8 million web pages&comma; and told to look at blocks of text to predict what word would come next&period;<&sol;p>&NewLine;<p>The system compared its guess with the actual text to &OpenCurlyDoubleQuote;learn”&period; This was repeated billions of times&comma; resulting in the GPT-2 software&period;<&sol;p>&NewLine;<p>Often within minutes&comma; GPT-2 can generate texts that look like they <a href&equals;"https&colon;&sol;&sol;openai&period;com&sol;blog&sol;better-language-models&sol;">were written by a human<&sol;a>&period; They’re grammatically correct&comma; thematically coherent&comma; engaging and even informative&period;<&sol;p>&NewLine;<p>I gave GPT-2 this prompt&colon; &OpenCurlyDoubleQuote;The global system of university ranking has recently…”&period; Here are some sentences it generated&colon;<&sol;p>&NewLine;<blockquote>&NewLine;<p>The global system of university ranking has recently been the subject of heated debate&comma; with many arguing that it is becoming increasingly irrelevant&period; In a report published in May&comma; the Organisation for Economic Co-operation and Development &lpar;OECD&rpar; found that the system has become increasingly irrelevant&comma; with the gap between the best and the worst universities in the world narrowing in recent years&period; The OECD found that in the past decade&comma; the average quality of a university’s research output has fallen to its lowest level since the late 1970s&period;<&sol;p>&NewLine;<&sol;blockquote>&NewLine;<p>There are several signs of a non-human hand at work&comma; notably the repetition of &OpenCurlyDoubleQuote;increasingly irrelevant”&period; There’s also the matter that no such OECD report exists&period; It was dreamt up by the machine&period;<&sol;p>&NewLine;<p>That said&comma; with a few revisions&comma; the text could probably pass as being authored by a human&period;<&sol;p>&NewLine;<p>There are a number of systems similar to GPT-2&comma; including <a href&equals;"https&colon;&sol;&sol;www&period;searchenginejournal&period;com&sol;bert-explained-what-you-need-to-know-about-googles-new-algorithm&sol;337247&sol;">Google’s BERT<&sol;a>&comma; <a href&equals;"https&colon;&sol;&sol;medium&period;com&sol;syncedreview&sol;baidus-ernie-2-0-beats-bert-and-xlnet-on-nlp-benchmarks-51a8c21aa433">ERNIE2&period;0<&sol;a>&comma; <a href&equals;"https&colon;&sol;&sol;mlexplained&period;com&sol;2019&sol;06&sol;30&sol;paper-dissected-xlnet-generalized-autoregressive-pretraining-for-language-understanding-explained&sol;">XLNet<&sol;a> and <a href&equals;"https&colon;&sol;&sol;pytorch&period;org&sol;hub&sol;pytorch&lowbar;fairseq&lowbar;roberta&sol;">Facebook’s RoBERTa<&sol;a>&period; But GPT-2 has caught on with tinkerers across the web – lauded for its <a href&equals;"https&colon;&sol;&sol;www&period;theverge&period;com&sol;2019&sol;11&sol;7&sol;20953040&sol;openai-text-generation-ai-gpt-2-full-model-release-1-5b-parameters">power<&sol;a> and ease of use in generating new texts&period;<&sol;p>&NewLine;<h2>Available now near you<&sol;h2>&NewLine;<p>GPT-2 comes in forms that let anyone use it easily&comma; even without a powerful computer&period; Such tools are a looming problem for schools and universities&period;<&sol;p>&NewLine;<p>In an experiment&comma; I fed the system 188 student papers on Keith Basso’s book <a href&equals;"https&colon;&sol;&sol;www&period;audible&period;com&period;au&sol;pd&sol;Wisdom-Sits-in-Places-Audiobook&sol;1977379095&quest;source&lowbar;code&equals;M2MOR131091619005N&amp&semi;gclsrc&equals;aw&period;ds&amp&semi;ds&lowbar;rl&equals;1252391&amp&semi;gclid&equals;EAIaIQobChMIjarRvuyY5wIVCpOPCh3WogYQEAAYASAAEgKVy&lowbar;D&lowbar;BwE">Wisdom Sits in Places<&sol;a>&comma; written for an anthropology course I teach&period; GPT-2 &OpenCurlyDoubleQuote;learned” for about thirty minutes&comma; after which it generated some paragraphs&period;<&sol;p>&NewLine;<p>One begins&colon;<&sol;p>&NewLine;<blockquote>&NewLine;<p>In this essay&comma; I will show how conceptions of wisdom connect with place-names in Wisdom Sits in Places&comma; by explaining how place-names serve as moral compass&period; I will also cover the cultural sphere of &OpenCurlyDoubleQuote;notions of morality”&comma; which is explained by the stories behind the place-names&period;<&sol;p>&NewLine;<&sol;blockquote>&NewLine;<p>The text reads like an essay&period; It’s divided into four paragraphs and describes what appears to be examples from the book&period;<&sol;p>&NewLine;<p>I would have failed the text as is&period; The writing isn’t perfect&comma; and in places the writer seems to lose their train of thought&period; However&comma; with slight human revision&comma; an essay worthy of a C would be within reach&period;<&sol;p>&NewLine;<h2>Adapt&comma; don’t resist<&sol;h2>&NewLine;<p>People are already experimenting with GPT-2 for <a href&equals;"https&colon;&sol;&sol;slatestarcodex&period;com&sol;2019&sol;03&sol;14&sol;gwerns-ai-generated-poetry&sol;">poetry<&sol;a>&comma; text-based role-playing games&comma; and plays written in a Shakespearean style&period; Worryingly&comma; it can also produce endless streams of fake news&period;<&sol;p>&NewLine;<p>What can institutions do about such &OpenCurlyDoubleQuote;plagiarised” work flooding their classrooms&quest;<&sol;p>&NewLine;<p>One response would be to ban AI tools&period; <a href&equals;"https&colon;&sol;&sol;www&period;theguardian&period;com&sol;education&sol;2018&sol;sep&sol;27&sol;university-chiefs-urge-education-secretary-to-ban-essay-mills">Leaders of 40 universities in the UK have taken this approach<&sol;a> against <a href&equals;"https&colon;&sol;&sol;www&period;theguardian&period;com&sol;education&sol;2019&sol;mar&sol;20&sol;essay-mills-prey-on-vulnerable-students-lets-stamp-them-out">essay mills<&sol;a>&comma; pushing to make them illegal&period; Essay mills are run by people who charge students a fee in exchange for completing their work&period;<&sol;p>&NewLine;<p>But it’s unclear how such a ban could be enforced once AI software is as easy to access as Candy Crush&period; Institutions could look to existing rules against academic misconduct&comma; but accurate detection becomes a problem&period; As AI-generated texts get better&comma; how will we prove &lpar;without watching them&rpar; that a student did or didn’t write a text themselves&quest;<&sol;p>&NewLine;<p>We can’t&comma; so we should take a page from <a href&equals;"https&colon;&sol;&sol;www&period;bbc&period;com&sol;future&sol;article&sol;20151201-the-cyborg-chess-players-that-cant-be-beaten">cyborg chess play<&sol;a>&comma; where players embrace chess-playing computers to become better themselves&period;<&sol;p>&NewLine;<p>Rather than pretending AI doesn’t exist&comma; it might be time to train people to write <em>with<&sol;em> AI&period;<&sol;p>&NewLine;<p>Most good writers don’t write in isolation&semi; they talk and revise their work with others&period; Also&comma; 90&percnt; of writing is revision&comma; which means the ideas and arguments in a text change and develop as a writer reads and edits their own work&period;<&sol;p>&NewLine;<p>Thus&comma; systems such as GPT-2 could be used as a first-draft machine&comma; taking a student’s raw research notes and turning them into a text they can expand on and revise&period;<&sol;p>&NewLine;<p>In this model&comma; teachers would evaluate a work&comma; not just on the basis of the final product&comma; but on a student’s ability to use text-generating tools&period;<&sol;p>&NewLine;<p>Powerful AI tools could help us analyse and communicate complex ideas&period;<&sol;p>&NewLine;<h2>What should we judge our students on&quest;<&sol;h2>&NewLine;<p>All of the above prompts a question we need to consider if we’re to live in an AI-friendly world&colon; why do we teach students to write at all&quest;<&sol;p>&NewLine;<p>One major reason is many jobs rely on being able to write&period; So&comma; when teaching writing&comma; we need to think about the social and economic implications of a type of text&period;<&sol;p>&NewLine;<p>Much of today’s media landscape&comma; for instance&comma; runs on the continuous production and circulation of blog posts&comma; tweets&comma; listicles&comma; marketing reports&comma; slide presentations&comma; and e-mails&period;<&sol;p>&NewLine;<p>While computer writing might never be as original&comma; provocative&comma; or insightful as the work of a skilled human&comma; it will quickly become good enough for such writing jobs&comma; and AIs won’t need health insurance or holidays&period;<&sol;p>&NewLine;<p>If we teach students to write things a computer can&comma; then we’re training them for jobs a computer can do&comma; for cheaper&period;<&sol;p>&NewLine;<p>Educators need to think creatively about the skills we give our students&period; In this context&comma; we can treat AI as an enemy&comma; or we can embrace it as a partner that helps us learn more&comma; work smarter&comma; and faster&period;<img src&equals;"https&colon;&sol;&sol;counter&period;theconversation&period;com&sol;content&sol;129905&sol;count&period;gif&quest;distributor&equals;republish-lightbox-basic" alt&equals;"The Conversation" width&equals;"1" height&equals;"1" &sol;><&sol;p>&NewLine;<h6><a href&equals;"https&colon;&sol;&sol;theconversation&period;com&sol;profiles&sol;grant-jun-otsuki-466450">Grant Jun Otsuki<&sol;a>&comma; Lecturer in Cultural Anthropology&comma; <em><a href&equals;"https&colon;&sol;&sol;theconversation&period;com&sol;institutions&sol;te-herenga-waka-victoria-university-of-wellington-1200">Te Herenga Waka—Victoria University of Wellington&period;<&sol;a><&sol;em>This article is republished from <a href&equals;"https&colon;&sol;&sol;theconversation&period;com&sol;">The Conversation<&sol;a> under a Creative Commons license&period; Read the <a href&equals;"https&colon;&sol;&sol;theconversation&period;com&sol;ok-computer-to-prevent-students-cheating-with-ai-text-generators-we-should-bring-them-into-the-classroom-129905">original article<&sol;a>&period;<&sol;h6>&NewLine;<div class&equals;"post-bottom-meta">&NewLine;<div class&equals;"post-bottom-meta-title"> <&sol;div>&NewLine;<&sol;div>&NewLine;

Explore our latest issue...
School News

School News is not affiliated with any government agency, body or political party. We are an independently owned, family-operated magazine.

Recent Posts

Are you teaching out of field? Your input is needed

A study investigating the realities of out-of-field teachers is seeking participants for groundbreaking research.

7 days ago

New resources to support media literacy teaching

The resources are designed to support teachers to make sure all students are engaged in…

7 days ago

Understanding tic disorders: What every school should know

Tic disorders are far more common than many people realise, and are often misrepresented in…

7 days ago

The modern library: More than a book storeroom

The school library has long been a place of discovery, reflection, and learning. But as…

7 days ago

Build a strong school community to prevent bullying

Is your school an inclusive community that empowers students to recognise bullying and to stand…

7 days ago

Government school enrolments at 10-year low

Performance indicators for the education and VET sectors have just been released with some encouraging…

2 weeks ago

This website uses cookies.