Photo: The Conversation
<h2><a href="https://www.oecd.org/pisa/pisa-2015-results-in-focus.pdf">Country rankings</a> in international education tests – such as <a href="https://www.oecd.org/pisa/pisa-2015-results-in-focus.pdf">PISA</a> and <a href="http://timssandpirls.bc.edu/timss2015/international-results/timss-2015/science/student-achievement/">TIMSS</a> – are often used to <a href="http://timssandpirls.bc.edu/timss2015/international-results/timss-2015/science/student-achievement/">compare and contrast</a> education systems across a range of countries. But it isn’t always an even playing field. </h2>
<p>This is because countries with very different social and economic realities participate, so countries such as Norway, Russia, Chile, Lebanon and Thailand are all being compared against each other. And this is without the difference in socio-economic backgrounds of these different countries being taken into account.</p>
<p>If the latest world education rankings are anything to go by, Turkey and Thailand perform poorly when it comes to their students’ achievement in science. But our analysis shows that if you look at the rankings differently (from an even starting point), both Thailand and Turkey may in fact be just as good as some of the high performing Asian countries. </p>
<p>Our analysis is a much fairer comparison, as it allows for the differences in wealth and social development in which students learn and teachers teach. It builds upon our <a href="https://theconversation.com/which-countries-punch-above-their-weight-in-education-rankings-49698">previous work</a>, where we produced and analysed an indicator of “effectiveness”. The effectiveness indicator ranks performance of countries as if they all had similar socio-economic conditions – thus levelling the playing field. </p>
<p>This makes it easier to see which countries are actually the most effective at educating their students, with social economic factors like wealth taken into account.</p>
<h2>New style rankings</h2>
<p>The graph below shows how countries are ranked in their effectiveness. At the top of the effectiveness ranking, we find education systems such as Singapore and Japan, which are also generally high performing in PISA and TIMSS. </p>
<figure class="align-center zoomable"><a href="https://cdn.theconversation.com/files/156821/area14mp/image-20170214-25995-1vea1if.png"><img src="https://cdn.theconversation.com/files/156821/width754/image-20170214-25995-1vea1if.png" alt="" /></a></p>
<div class="enlarge_hint"> </div><figcaption><span class="caption">TIMSS-PISA 2015. Values higher than zero (towards the right-hand side) indicate that students in those education systems perform above expectations, meaning the education system is effective. Those values below zero, to the left, indicate ineffective education systems.</span> <span class="attribution">Author provided</span></figcaption></figure>
<p>But our analysis also revealed that countries such as Turkey and Thailand are actually highly effective and perform above expectations in terms of education. This is despite both countries having an overall lower performance score in the global education rankings.</p>
<p>As the graph shows, the performance of education systems in Turkey and Thailand is underestimated if guided by country rankings alone. This is because although these countries perform below average and rather poorly in PISA, they are as effective as high performing Asian countries. </p>
<p>This means that Turkey and Thailand would be ranked among the highest performing countries in the world – if there was no socio-economic differences between countries.</p>
<figure class="align-center zoomable"><a href="https://cdn.theconversation.com/files/156769/area14mp/image-20170214-25999-9qzn0s.png"><img src="https://cdn.theconversation.com/files/156769/width754/image-20170214-25999-9qzn0s.png" alt="" /></a></p>
<div class="enlarge_hint"> </div><figcaption><span class="caption">TIMSS-PISA 2015. Effectiveness vs performance according to rankings. The horizontal line at 0 separates effective from ineffective systems and the vertical line at 500 indicates average performance for TIMSS and OECD education systems.</span><span class="attribution">Author provided</span></figcaption></figure>
<p>Our analysis also shows education systems in Norway are ineffective, and the same was found to be true of Australia. So while these countries are ranked highest in <a href="http://hdr.undp.org/en/composite/HDI">human development</a> in the world, they are not among the highest performing in these international tests when we level the playing field. </p>
<p>On the lower end of the effectiveness ranking, we find Qatar and the United Arab Emirates. These countries are also among the lowest performing in PISA rankings and could be doing much better for their high <a href="http://data.worldbank.org/indicator/NY.GDP.PCAP.PP.CD">income per capita</a> levels. </p>
<h2>Fair comparison</h2>
<p>It is clear then that overall performance rankings alone do not make a fair comparison when it comes to judging the quality of education in different countries. And our analysis shows how the socioeconomic conditions of a country are vitally important when comparing global performance in education rankings. </p>
<p>Using our data, there would certainly be a case for countries like Chile, Malta, Georgia, the United Arab Emirates and Qatar to look to Turkey and Thailand to work out how to improve their education systems. And as our analysis shows, global education rankings are probably not the best measure of educational performance after all.</p>
<p><img class="alignleft size-full wp-image-5426" src="http://www.school-news.com.au/wp-content/uploads/2016/10/creative-commons.png" alt="creative-commons" width="88" height="31" />This piece was written by Daniel Caro and Jenny Lenkit, research fellows, Oxford University Centre for Educational Assessment, University of Oxford. The article was originally published on <a href="https://theconversation.com/why-global-education-rankings-dont-reveal-the-whole-picture-72134"><em>The Conversation.</em></a></p>

A study investigating the realities of out-of-field teachers is seeking participants for groundbreaking research.
The resources are designed to support teachers to make sure all students are engaged in…
Tic disorders are far more common than many people realise, and are often misrepresented in…
The school library has long been a place of discovery, reflection, and learning. But as…
Is your school an inclusive community that empowers students to recognise bullying and to stand…
Performance indicators for the education and VET sectors have just been released with some encouraging…
This website uses cookies.