Conversation

Notices

1. Embed this notice
   Ruth Mottram (ruth_mottram@fediscience.org)'s status on Wednesday, 06-Dec-2023 18:59:03 JST Ruth Mottram

   Lots of anguish in various countries media about #PISA scores which seem to have slumped after the pandemic (though the economist rightly notes they were on a long slow decline before too).
   What I really want to read though is a thorough statistical analysis - what do the numbers actually mean? What's the uncertainty range? What is the spread within the numbers? Is #PISA22 even measuring what we think it is + just how comparable across countries are the test conditions?
   Any takers?

   • HistoPol (#HP) 🥥 🌴 repeated this.
   • Embed this notice
     Pedro J. Hdez (ecosdelfuturo@mstdn.social)'s status on Wednesday, 06-Dec-2023 22:55:28 JST Pedro J. Hdez

     in reply to

     @Ruth_Mottram

     PISA takes the benchmark of 500 as the OECD average for 15-year-old students. For most countries the difference is very small. E.g., in PISA 2012 Denmark scored 498 and Spain 496 in science. That puts Spain in 21st place out of 34 countries, which was considered by here as a disastrous result.

     There seems to be some consensus that the PISA methodology is appropriate, but that doesn't imply that the differences are significant or that you can deduce where they are significant +

     HistoPol (#HP) 🥥 🌴 repeated this.
   • Embed this notice
     Pedro J. Hdez (ecosdelfuturo@mstdn.social)'s status on Wednesday, 06-Dec-2023 22:55:52 JST Pedro J. Hdez

     in reply to

     @Ruth_Mottram

     Some examples of criticisms have pointed to problems in controlling response rates (https://www.tandfonline.com/doi/abs/10.1080/0305498042000303017) or in the choice of the population based on age and not grade (https://nap.nationalacademies.org/read/10322/chapter/5#82) or the lack of correlation due to student motivation (https://www.frontiersin.org/articles/10.3389/feduc.2021.791599/full) or the cultural disaffection of the student body with the subject matter (https://dera.ioe.ac.uk/id/eprint/6448/1/RR772.pdf p.95).

     Hope all this has put some of the context you were looking for.