Hannah Barnes
speaker
509 appearances
22 recordings
1 series
first heard Mar 2011
last heard Oct 2013
Hannah Barnes’s voice in public audio — every appearance, attributed to the second.
Trend
recordings per month · last 12 monthsNo recordings in the last 12 months.Older appearances are listed below; set an alert to hear about the next one.
Appearances
And crucially, those items are meant to be equally difficult for everyone in every country.
voice-verified
Well, it's not going to be easy, and Sven thinks that Pisa hasn't been able to do it.
voice-verified
How big a difference can that make then?
voice-verified
I put that to PISA though and they said it's impossible to do that.
voice-verified
They said, quote, simply nonsense.
voice-verified
If Professor Kreiner's right, and there's this thing called differential item functioning, or DIF, to such a high degree, then it's really important because the statistical scaling model that PISA uses, the rash model, is meant to be used only when this problem, DIF, is eliminated.
voice-verified
Sven Kreiner says there's no evidence PISA has been able to do that.
voice-verified
Yeah, he is.
voice-verified
So I put what Professor Kreiner told me to Andreas Schleicher from PISA.
voice-verified
He says they'll prepare a full response when Kreiner's paper is published.
voice-verified
But in the meantime, he had this to say.
voice-verified
The problem is, though, that Professor Kreiner claims that
voice-verified
The fact that you have differential item functioning means that you are using the wrong model.
voice-verified
The statistical model requires that there isn't differential item functioning.
voice-verified
And he says that there is not one single item that is the same for all countries, not one across the 56 countries, and therefore you cannot use this model.
voice-verified
Yeah.
voice-verified
I hoped you wouldn't ask that, Tim, because, to be honest, I'm not sure.
voice-verified
I've shown Kreiner's paper to other academics in this field, and I've been told it's sound.
voice-verified
As I say, PISA told me they wanted to wait for Kreiner's study to be published in a peer-reviewed journal before commenting.
voice-verified
But then, just before I came in to record this, PISA sent me a rebuttal written by the man who carries out their statistical analysis, Ray Adams.
voice-verified
Showing 401–420 of 509 · page 21 of 26
← Previous
Next →