Arvan, Marcus and Bright, Liam Kofi and Heesen, Remco (2022) Jury Theorems for Peer Review. The British Journal for the Philosophy of Science. ISSN 1464-3537

Preview

Text Arvan et al 2022 Jury Theorems for Peer Review (British Journal for the Philosophy of Science accepted manuscript).pdf - Accepted Version Available under License Creative Commons Attribution Non-commercial. Download (388kB) | Preview

Abstract

Peer review is often taken to be the main form of quality control on academic research. Usually journals carry this out. However, parts of maths and physics appear to have a parallel, crowd-sourced model of peer review, where papers are posted on the arXiv to be publicly discussed. In this paper we argue that crowd-sourced peer review is likely to do better than journal-solicited peer review at sorting papers by quality. Our argument rests on two key claims. First, crowd-sourced peer review will lead on average to more reviewers per paper than journal-solicited peer review. Second, due to the wisdom of the crowds, more reviewers will tend to make better judgments than fewer. We make the second claim precise by looking at the Condorcet Jury Theorem as well as two related jury theorems developed specifically to apply to peer review.

---

Export/Citation:

EndNote | BibTeX | Dublin Core | ASCII/Text Citation (Chicago) | HTML Citation | OpenURL

Social Networking:

Share |

---

Item Type:	Published Article or Volume
Creators:	Creators Email ORCID Arvan, Marcus marvan@ut.edu Bright, Liam Kofi liamkbright@gmail.com 0000-0001-5450-8748 Heesen, Remco r.heesen@lse.ac.uk 0000-0003-3823-944X
Keywords:	Philosophy of science Peer review Condorcet Jury Theorem Formal epistemology Social epistemology Bias
Subjects:	General Issues > Decision Theory Specific Sciences > Probability/Statistics General Issues > Science and Policy General Issues > Social Epistemology of Science
Depositing User:	Remco Heesen
Date Deposited:	30 Jan 2022 05:07
Last Modified:	09 Aug 2023 14:10
Item ID:	20164
Journal or Publication Title:	The British Journal for the Philosophy of Science
Official URL:	https://doi.org/10.1086/719117
DOI or Unique Handle:	10.1086/719117
Subjects:	General Issues > Decision Theory Specific Sciences > Probability/Statistics General Issues > Science and Policy General Issues > Social Epistemology of Science
Date:	20 January 2022
ISSN:	1464-3537
URI:	https://philsci-archive.pitt.edu/id/eprint/20164

Available Versions of this Item

• Jury Theorems for Peer Review. (deposited 25 Apr 2019 12:52)
  • Jury Theorems for Peer Review. (deposited 22 Aug 2020 03:18)
    • Jury Theorems for Peer Review. (deposited 30 Jan 2022 05:07) [Currently Displayed]

Monthly Views for the past 3 years

Monthly Downloads for the past 3 years

Plum Analytics

Altmetric.com

Actions (login required)

View Item