"Scientists have run studies where they deliberately add errors to papers, send them out to reviewers, and simply count how many errors the reviewers catch. Reviewers are pretty awful at this. [Reviewers caught 25-30% of the major flaws.]
These were critical issues, like “the paper claims to be a randomized controlled trial but it isn’t” and “when you look at the graphs, it’s pretty clear there’s no effect” and “the authors draw conclusions that are totally unsupported by the data.” Reviewers mostly didn’t notice."
https://www.experimental-history.com/p/the-rise-and-fall-of-peer-review
Embed Notice
HTML Code
Corresponding Notice
- Embed this notice
Abie (temptoetiam@eldritch.cafe)'s status on Sunday, 09-Feb-2025 08:05:44 JST Abie