Charles Piller
👤 SpeakerAppearances Over Time
Podcast Appearances
How does that factor in when we look at our hierarchy of evidence and expert opinion being low on that pyramid, and as you go higher to the meta-analyses, the systemic reviews, how does it factor in that there are perhaps studies that were done with poor data, falsified data? How does that impact our ability to do those high-quality reviews?
How does that factor in when we look at our hierarchy of evidence and expert opinion being low on that pyramid, and as you go higher to the meta-analyses, the systemic reviews, how does it factor in that there are perhaps studies that were done with poor data, falsified data? How does that impact our ability to do those high-quality reviews?
Well, I think the reviews are only as good as the stuff that they're built on, so it's garbage in, garbage out, I'm afraid. And if studies are unreliable, they can have that ripple effect. Also, you see in many of the metadata studies and the reviews that you're referring to, even by some of the best review organizations like the Cochrane folks over in the UK,
Well, I think the reviews are only as good as the stuff that they're built on, so it's garbage in, garbage out, I'm afraid. And if studies are unreliable, they can have that ripple effect. Also, you see in many of the metadata studies and the reviews that you're referring to, even by some of the best review organizations like the Cochrane folks over in the UK,
Well, I think the reviews are only as good as the stuff that they're built on, so it's garbage in, garbage out, I'm afraid. And if studies are unreliable, they can have that ripple effect. Also, you see in many of the metadata studies and the reviews that you're referring to, even by some of the best review organizations like the Cochrane folks over in the UK,
Those are done with extremely high standards, and they try to throw out data often that isn't really that reliable. The problem is, if data is falsified, it can be very difficult to know how reliable it is. And so therefore, you see over and over again that a lot of these review studies are equivocal in their conclusions. They don't come down firmly on one side or another.
Those are done with extremely high standards, and they try to throw out data often that isn't really that reliable. The problem is, if data is falsified, it can be very difficult to know how reliable it is. And so therefore, you see over and over again that a lot of these review studies are equivocal in their conclusions. They don't come down firmly on one side or another.
Those are done with extremely high standards, and they try to throw out data often that isn't really that reliable. The problem is, if data is falsified, it can be very difficult to know how reliable it is. And so therefore, you see over and over again that a lot of these review studies are equivocal in their conclusions. They don't come down firmly on one side or another.
Is this treatment valuable or is it worthless? They often say, well, we can't really quite tell. And the forest plots all over the place. There we go. It's partly because you have not enough data. It's partly because sometimes you have poorly done studies or even falsified data that skews the overall thinking in the field and the ability to combine it just for a concrete solution. Hmm.
Is this treatment valuable or is it worthless? They often say, well, we can't really quite tell. And the forest plots all over the place. There we go. It's partly because you have not enough data. It's partly because sometimes you have poorly done studies or even falsified data that skews the overall thinking in the field and the ability to combine it just for a concrete solution. Hmm.
Is this treatment valuable or is it worthless? They often say, well, we can't really quite tell. And the forest plots all over the place. There we go. It's partly because you have not enough data. It's partly because sometimes you have poorly done studies or even falsified data that skews the overall thinking in the field and the ability to combine it just for a concrete solution. Hmm.
Where do paper mills fall into this equation?
Where do paper mills fall into this equation?
Where do paper mills fall into this equation?
Well, this is a phenomenon that is a pernicious effect on scientific research. So I mentioned before the publisher-parish ethos within scientific careers. And because of the pressure that scientists feel and the competitive nature of the field—the too few jobs for too many PhDs, for example—
Well, this is a phenomenon that is a pernicious effect on scientific research. So I mentioned before the publisher-parish ethos within scientific careers. And because of the pressure that scientists feel and the competitive nature of the field—the too few jobs for too many PhDs, for example—
Well, this is a phenomenon that is a pernicious effect on scientific research. So I mentioned before the publisher-parish ethos within scientific careers. And because of the pressure that scientists feel and the competitive nature of the field—the too few jobs for too many PhDs, for example—
What you have is a situation where clever entrepreneurs, if you want to call them that, have developed these companies where they generate fake papers. In other words, kind of interesting sounding papers. kind of plausible sounding scientific papers. And then they sell authorships to the papers. Sometimes these are generated even by AI programs.
What you have is a situation where clever entrepreneurs, if you want to call them that, have developed these companies where they generate fake papers. In other words, kind of interesting sounding papers. kind of plausible sounding scientific papers. And then they sell authorships to the papers. Sometimes these are generated even by AI programs.
What you have is a situation where clever entrepreneurs, if you want to call them that, have developed these companies where they generate fake papers. In other words, kind of interesting sounding papers. kind of plausible sounding scientific papers. And then they sell authorships to the papers. Sometimes these are generated even by AI programs.