Categories: Education

Five things we wouldn’t know without NAPLAN

<p>The Conversation<&sol;p>&NewLine;<p><a href&equals;"https&colon;&sol;&sol;theconversation&period;com&sol;profiles&sol;peter-goss-162374" rel&equals;"author"><span class&equals;"fn author-name">Peter Goss <&sol;span> &comma; <&sol;a>School Education Program Director&comma; Grattan Institute<&sol;p>&NewLine;<h2>NAPLAN&comma; the National Assessment Program &&num;8211&semi; Literacy and Numeracy&comma; has been a prominent part of Australia’s education landscape since 2008&comma; when it was introduced by then Education Minister Julia Gillard&period;<&sol;h2>&NewLine;<p>It’s a controversial test&comma; lauded by some but disliked by many&period;<&sol;p>&NewLine;<p>Ten years on&comma; the role of NAPLAN is under question&comma; with some arguing it should be dropped entirely&period; Here’s why it’s a vital navigation tool for policy makers and researchers&period;<&sol;p>&NewLine;<p>Every May&comma; Australian school students in years three&comma; five&comma; seven and nine sit standardised tests in reading&comma; writing&comma; numeracy&comma; spelling and grammar&period;<&sol;p>&NewLine;<p>A great virtue of NAPLAN is that each domain is scored on a single scale&period; Achievement can be compared across different school year levels&comma; courtesy of a common learning progression for all levels of the NAPLAN tests&period; This lets us analyse the learning growth of specific groups of students as they move through school&period;<&sol;p>&NewLine;<p>I have <a href&equals;"https&colon;&sol;&sol;grattan&period;edu&period;au&sol;report&sol;targeted-teaching-how-better-use-of-data-can-improve-student-learning&sol;">consistently argued<&sol;a> the best way to lift achievement is to maximise individual learning progress&period; The same theme underpins the <a href&equals;"https&colon;&sol;&sol;docs&period;education&period;gov&period;au&sol;system&sol;files&sol;doc&sol;other&sol;662684&lowbar;tgta&lowbar;accessible&lowbar;final&lowbar;0&period;pdf">Gonski 2&period;0<&sol;a> report&period; And if we want to lift learning progress at scale&comma; we must be able to measure it&period;<&sol;p>&NewLine;<h2>What is NAPLAN used for&quest;<&sol;h2>&NewLine;<p>There are many claims about the benefits of NAPLAN&comma; each of which deserves scrutiny on its merits&period; For example&comma; using NAPLAN&colon;<&sol;p>&NewLine;<ul>&NewLine;<li>&NewLine;<p>policy makers and researchers can better understand student performance&comma; to inform system-wide policies&comma; support and resource allocation for schools<&sol;p>&NewLine;<&sol;li>&NewLine;<li>&NewLine;<p>teachers can use the data as a diagnostic tool to improve teaching in the classroom<&sol;p>&NewLine;<&sol;li>&NewLine;<li>&NewLine;<p>parents can make more informed choices about where to send their children&comma; via the <a href&equals;"https&colon;&sol;&sol;www&period;myschool&period;edu&period;au">My School website<&sol;a> which publishes school-level results<&sol;p>&NewLine;<&sol;li>&NewLine;<li>&NewLine;<p><a href&equals;"http&colon;&sol;&sol;www&period;nap&period;edu&period;au&sol;docs&sol;default-source&sol;default-document-library&sol;naplan-2018-information-brochure-for-parents-and-carers&period;pdf&quest;sfvrsn&equals;2">parents have more information<&sol;a> about how their child is progressing relative to others&period;<&sol;p>&NewLine;<&sol;li>&NewLine;<&sol;ul>&NewLine;<p>Focusing just on the first point&comma; here are five things we know a lot more about because of NAPLAN&period;<&sol;p>&NewLine;<h2>1&period; Achievement gaps for Indigenous students<&sol;h2>&NewLine;<p>Indigenous students don’t achieve at the same level as their non-Indigenous peers&period; While this has been known for decades&comma; we would not know just how large some of these gaps are without NAPLAN&comma; or how the gaps have changed over time&period;<&sol;p>&NewLine;<p><a href&equals;"https&colon;&sol;&sol;theconversation&period;com&sol;closing-the-gap-in-indigenous-literacy-and-numeracy-not-remotely-or-in-cities-88704">At a national level<&sol;a>&comma; year nine Indigenous students are on average three years behind non-Indigenous students in numeracy&comma; 3&period;4 years behind in reading&comma; and 4&period;2 years behind in writing&period;<&sol;p>&NewLine;<p>Translating NAPLAN scores into <a href&equals;"https&colon;&sol;&sol;grattan&period;edu&period;au&sol;report&sol;widening-gaps&sol;">equivalent year levels<&sol;a> makes it much easier to understand and compare performance across student groups&period; But the Indigenous gap is so large that no fancy mathematics is needed&colon; year nine Indigenous students scored on average 465 in NAPLAN writing in 2017&comma; below the 480 non-Indigenous students scored in year five&period;<&sol;p>&NewLine;<p>The gaps are even larger in very remote areas where Indigenous students are more than seven years behind in writing&period;<&sol;p>&NewLine;<h2>2&period; Progress gaps for students in disadvantaged schools<&sol;h2>&NewLine;<p>Students in disadvantaged schools perform worse&period; Again&comma; not news&period;<&sol;p>&NewLine;<p>What’s more of a surprise is that&comma; when we tracked a cohort of Victorian students across all four of their NAPLAN tests&comma; the size of the gap tripled&comma; from one year and three months in year three to three years and eight months in year nine&period;<&sol;p>&NewLine;<p>Even more concerning was the finding when we compared students with comparable capabilities early in their schooling&period; From the same year three starting score&comma; students in disadvantaged schools fall more than two years behind by year nine&comma; with potentially high-achieving students missing out the most&period;<&sol;p>&NewLine;<p><strong>Students with similar early potential do worse in disadvantaged schools&comma; especially high-achieving students<&sol;strong>&period;<&sol;p>&NewLine;<h2>3&period; Comparison among states<&sol;h2>&NewLine;<p>The states and territories are responsible for running school education in Australia&period; Different states and territories take different approaches&period; In theory&comma; this means jurisdictions can learn from each other&period; But this requires accurate comparisons&comma; which take account of socio-economic differences&period; For example&comma; parents in some states have higher levels of education than in others&period;<&sol;p>&NewLine;<p>On a like-for-like basis&comma; comparable students are achieving at very different levels depending where they live in Australia&period;<&sol;p>&NewLine;<p>Looking at the next level of detail makes it clear no state or territory can afford to be complacent&period;<&sol;p>&NewLine;<p>For example&comma; New South Wales has the highest levels of achievement of any state for students whose parents have a university degree&comma; but its disadvantaged students make less progress than the national average&period; By contrast&comma; Victoria has the highest achievement levels for students whose parents didn’t finish school&comma; but is not stretching its most advantaged students in the same way&period;<&sol;p>&NewLine;<h2>4&period; Changes over time<&sol;h2>&NewLine;<p>NAPLAN has now been running for long enough to identify trends over time&period; Too often&comma; the story is one of stagnation&period; But there are bright spots&comma; including the early years in Queensland&period;<&sol;p>&NewLine;<p><strong>Relative to the rest of Australia&comma; Queensland has increased its year three numeracy and reading scores by three to four months since 2010<&sol;strong><&sol;p>&NewLine;<p>It’s interesting to note 2010 was the first NAPLAN cohort where Queensland students started school with a Prep year&period; This probably accounts for some of the improvement&period; But it’s also notable that the relative levels of achievement have improved over time&comma; not just in a single step&comma; suggesting Queensland’s education system is getting some other things right&period;<&sol;p>&NewLine;<p>The richness of NAPLAN data allows us to spot much more subtle patterns as well&period; For example&comma; while very remote Indigenous students are doing very poorly in writing&comma; there are <a href&equals;"https&colon;&sol;&sol;theconversation&period;com&sol;closing-the-gap-in-indigenous-literacy-and-numeracy-not-remotely-or-in-cities-88704">signs of improvement in this cohort in NSW<&sol;a>&period; This level of granular analysis would not be possible without the NAPLAN tests being done every year&comma; by all schools&period;<&sol;p>&NewLine;<h2>5&period; Identifying high-growth schools<&sol;h2>&NewLine;<p>The &OpenCurlyDoubleQuote;holy grail” for many advocates of NAPLAN is to use it to identify the schools that are most effective in maximising student learning growth&comma; and to apply lessons from those schools to others not adding as much value&period;<&sol;p>&NewLine;<p>This is easier said than done&comma; not least because the socioeconomic mix in each school affects the rate of learning growth as well as the students’ achievement&period;<&sol;p>&NewLine;<p>New analysis&comma; taking socioeconomic factors into account&comma; shows that about 8&percnt; of schools have &OpenCurlyDoubleQuote;beaten their odds” for all five cohorts for which we have reliable NAPLAN progress data&period; Given this would only occur 3&percnt; of the time for a coin toss&comma; we can confidently say that at least 5&percnt; of Australia’s schools are routinely out-performing&period;<&sol;p>&NewLine;<p><strong>About 5&percnt; of schools are routinely doing better than we would expect given their student population mix<&sol;strong><&sol;p>&NewLine;<p>Of course&comma; NAPLAN can’t tell us why these schools are different&period; Maybe it’s what the schools and their teachers are doing&period; Maybe it’s the nature of their incoming cohort&period; Whatever it is&comma; we need to know&period;<&sol;p>&NewLine;<h2>Where to from here<&sol;h2>&NewLine;<p>NAPLAN is an imperfect navigation tool&period; It certainly doesn’t have GPS-like levels of precision&period; But giving up on NAPLAN would be like 19th-century sailors dumping sextants and chronometers in favour of returning to using the stars&comma; wind and currents to navigate&period;<&sol;p>&NewLine;<p>Maybe we need to rethink how NAPLAN is used&comma; but overall&comma; it should be kept&period;<&sol;p>&NewLine;

Explore our latest issue...
The Conversation

Recent Posts

Are you teaching out of field? Your input is needed

A study investigating the realities of out-of-field teachers is seeking participants for groundbreaking research.

7 days ago

New resources to support media literacy teaching

The resources are designed to support teachers to make sure all students are engaged in…

7 days ago

Understanding tic disorders: What every school should know

Tic disorders are far more common than many people realise, and are often misrepresented in…

7 days ago

The modern library: More than a book storeroom

The school library has long been a place of discovery, reflection, and learning. But as…

7 days ago

Build a strong school community to prevent bullying

Is your school an inclusive community that empowers students to recognise bullying and to stand…

7 days ago

Government school enrolments at 10-year low

Performance indicators for the education and VET sectors have just been released with some encouraging…

2 weeks ago

This website uses cookies.