Heesen, Remco and Bright, Liam Kofi (2025) Publication Bias is Bad for Science if not Necessarily Scientists. Royal Society Open Science, 12 (4). p. 240688. ISSN 2054-5703
![[img]](https://philsci-archive.pitt.edu/style/images/fileicons/text.png) |
Text
Heesen Bright 2025 Publication Bias is Bad for Science if not Necessarily Scientists (Royal Society Open Science).pdf - Published Version Available under License Creative Commons Attribution. Download (536kB) |
Abstract
It might seem obvious that the scientific process should not be biased. We strive for reliable inference, and systematically skewing the results of inquiry apparently conflicts with this. Publication bias—which involves only publishing certain types of results—seems particularly troubling and has been blamed for the replication crisis. While we ultimately agree, there are considerable nuances to take into account. Using a Bayesian model of scientific reasoning we show that a scientist who is aware of publication bias can (theoretically) interpret the published literature so as to avoid acquiring biased beliefs. Moreover, in some highly specific circumstances she might prefer not to bother with policies designed to mitigate or reduce the presence of publication bias—it would impose a cost in time or effort that she would not see any benefit in paying. However, we also argue that science as a social endeavour is made worse off by publication bias. This is because the social benefits of science are largely secured via go-between agents, various non-experts who nonetheless need to make use of or convey the results of scientific inquiry if its fruits are to be enjoyed by society at large. These are unlikely to be well-informed enough to account for publication bias appropriately. As such, we conclude, the costs of having to implement policies like mandatory pre-registration are worth imposing on scientists, even if they would perhaps not view these costs as worth paying for their own sake. The benefits are reaped by the go-between agents, and we argue that their perspective is quite properly favoured when deciding how to govern scientific institutions.
| Export/Citation: | EndNote | BibTeX | Dublin Core | ASCII/Text Citation (Chicago) | HTML Citation | OpenURL |
| Social Networking: |
| Item Type: | Published Article or Volume | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Creators: |
|
|||||||||
| Keywords: | publication bias; filedrawer effect; preregistration; philosophy of statistics; replication crisis | |||||||||
| Subjects: | General Issues > Decision Theory Specific Sciences > Probability/Statistics General Issues > Social Epistemology of Science |
|||||||||
| Depositing User: | Remco Heesen | |||||||||
| Date Deposited: | 11 May 2025 15:06 | |||||||||
| Last Modified: | 11 May 2025 15:06 | |||||||||
| Item ID: | 25267 | |||||||||
| Journal or Publication Title: | Royal Society Open Science | |||||||||
| Publisher: | The Royal Society of London | |||||||||
| Official URL: | https://doi.org/10.1098/rsos.240688 | |||||||||
| DOI or Unique Handle: | 10.1098/rsos.240688 | |||||||||
| Subjects: | General Issues > Decision Theory Specific Sciences > Probability/Statistics General Issues > Social Epistemology of Science |
|||||||||
| Date: | April 2025 | |||||||||
| Page Range: | p. 240688 | |||||||||
| Volume: | 12 | |||||||||
| Number: | 4 | |||||||||
| ISSN: | 2054-5703 | |||||||||
| URI: | https://philsci-archive.pitt.edu/id/eprint/25267 |
Monthly Views for the past 3 years
Monthly Downloads for the past 3 years
Plum Analytics
Altmetric.com
Actions (login required)
 |
View Item |
![[feed]](http://philsci-archive.pitt.edu/style/images/feed-icon-32x32.png){kind=icon}