PhilSci Archive

Conflicting results and statistical malleability: embracing pluralism of empirical results

Maziarz, Mariusz (2024) Conflicting results and statistical malleability: embracing pluralism of empirical results. [Preprint]

[img]
Preview
Text
Maziarz_Conflicting results and statistical malleability.pdf

Download (319kB) | Preview

Abstract

Conflicting results undermine making inferences from the empirical literature. So far, the replication crisis is mainly seen as resulting from honest errors and questionable research practices such as p-hacking or the base-rate fallacy. We discuss the malleability (researcher degrees of freedom) of quantitative research and argue that conflicting results can emerge from two studies using different but plausible designs (e.g., eligibility criteria, operationalization of concepts, outcome measures) and statistical methods. We also explore how the choices regarding study design and statistical techniques bias results in a way that makes them more or less relevant for a given policy or clinical question.


Export/Citation: EndNote | BibTeX | Dublin Core | ASCII/Text Citation (Chicago) | HTML Citation | OpenURL
Social Networking:
Share |

Item Type: Preprint
Creators:
CreatorsEmailORCID
Maziarz, Mariuszmariusz.maziarz@uj.edu.pl0000-0003-1979-0746
Keywords: recalcitrant results, conflicting results, scientific pluralism
Subjects: General Issues > Causation
Specific Sciences > Economics
General Issues > Evidence
Specific Sciences > Medicine
Specific Sciences > Psychology
Depositing User: Mr Mariusz Maziarz
Date Deposited: 21 Feb 2024 17:09
Last Modified: 21 Feb 2024 17:09
Item ID: 23107
Official URL: https://direct.mit.edu/posc/article-abstract/doi/1...
DOI or Unique Handle: https://doi.org/10.1162/posc_a_00627
Subjects: General Issues > Causation
Specific Sciences > Economics
General Issues > Evidence
Specific Sciences > Medicine
Specific Sciences > Psychology
Date: 20 February 2024
URI: https://philsci-archive.pitt.edu/id/eprint/23107

Monthly Views for the past 3 years

Monthly Downloads for the past 3 years

Plum Analytics

Altmetric.com

Actions (login required)

View Item View Item