Rubin, Mark (2023) Rubin (2023) - Questionable Metascience Practices. Journal of Trial and Error.
|
Text
Rubin (2023) - QMPs.pdf - Published Version Available under License Creative Commons Attribution. Download (339kB) | Preview |
Abstract
Metascientists have studied questionable research practices in science. The present article considers the parallel concept of questionable metascience practices (QMPs). A QMP is a research practice, assumption, or perspective that has been questioned by several commentators as being potentially problematic for metascience and/or the science reform movement. The present article reviews ten QMPs that relate to criticism, replication, bias, generalization, and the characterization of science. Specifically, the following QMPs are considered: (1) rejecting or ignoring self criticism; (2) a fast ‘n’ bropen scientific criticism style; (3) overplaying the role of replication in science; (4) assuming a replication rate is “too low” without specifying an “acceptable” rate; (5) an unacknowledged metabias towards explaining the replication crisis in terms of researcher bias; (6) assuming that researcher bias can be reduced; (7) devaluing exploratory results as being more “tentative” than confirmatory results; (8) presuming that questionable research practices are problematic research practices; (9) focusing on knowledge accumulation; and (10) focusing on specific scientific methods. It is stressed that only some metascientists engage in some QMPs some of the time, and that these QMPs may not always be problematic. Research is required to estimate the prevalence and impact of QMPs. In the meantime, QMPs should be viewed as invitations to ask questions about how we go about doing better metascience.
| Export/Citation: | EndNote | BibTeX | Dublin Core | ASCII/Text Citation (Chicago) | HTML Citation | OpenURL |
| Social Networking: |
| Item Type: | Published Article or Volume | ||||||
|---|---|---|---|---|---|---|---|
| Creators: |
|
||||||
| Keywords: | metascience; open science; questionable research practices; replication crisis; science reform | ||||||
| Subjects: | General Issues > Explanation Specific Sciences > Psychology General Issues > Science and Policy General Issues > Social Epistemology of Science |
||||||
| Depositing User: | Dr Mark Rubin | ||||||
| Date Deposited: | 30 Aug 2023 07:44 | ||||||
| Last Modified: | 30 Aug 2023 07:44 | ||||||
| Item ID: | 22465 | ||||||
| Journal or Publication Title: | Journal of Trial and Error | ||||||
| Official URL: | https://doi.org/10.36850/mr4 | ||||||
| DOI or Unique Handle: | 10.36850/mr4 | ||||||
| Subjects: | General Issues > Explanation Specific Sciences > Psychology General Issues > Science and Policy General Issues > Social Epistemology of Science |
||||||
| Date: | 24 April 2023 | ||||||
| URI: | https://philsci-archive.pitt.edu/id/eprint/22465 |
Monthly Views for the past 3 years
Monthly Downloads for the past 3 years
Plum Analytics
Altmetric.com
Actions (login required)
 |
View Item |
![[feed]](http://philsci-archive.pitt.edu/style/images/feed-icon-32x32.png){kind=icon}