PhilSci Archive

Minimum Viable Experiment to Replicate

Devezer, Berna and Buzbas, Erkan (2021) Minimum Viable Experiment to Replicate. [Preprint]

[img]
Preview
Text
MVE.pdf

Download (177kB) | Preview

Abstract

Replication experiments purport to independently validate claims from previous research or provide some diagnostic evidence about their reliability. In practice, this value of replication experiments is often taken for granted. Our research shows that in replication experiments, practice often does not live up to theory. Most replication experiments in practice are confounded and their results multiply determined, hence uninterpretable. These results can be driven by the true data generating mechanism, issues present in the original experiment, discrepancies between the original and the replication experiment, new issues introduced in the replication experiment, or combinations of any of these factors. The answers we are looking for with regard to the true state of nature require a rigorous and meticulous investigative process of eliminating errors and singling out elementary or pure cases. In this paper, we introduce the idea of a minimum viable experiment that needs to be identified in practice for replication results to be clearly interpretable. Most experiments are not replication-ready and before striving to replicate a given result, we need theoretical precision or systematic exploration to discover empirical regularities.


Export/Citation: EndNote | BibTeX | Dublin Core | ASCII/Text Citation (Chicago) | HTML Citation | OpenURL
Social Networking:
Share |

Item Type: Preprint
Creators:
CreatorsEmailORCID
Devezer, Bernabdevezer@uidaho.edu0000-0002-5979-2781
Buzbas, Erkanerkanb@uidaho.edu
Keywords: Replication, reproducibility, epistemic iteration, exploratory experimentation, idealized experiment, minimalism
Subjects: General Issues > Experimentation
General Issues > History of Philosophy of Science
General Issues > Reductionism/Holism
Depositing User: Dr. Berna Devezer
Date Deposited: 26 Nov 2022 23:02
Last Modified: 26 Nov 2022 23:02
Item ID: 21475
Subjects: General Issues > Experimentation
General Issues > History of Philosophy of Science
General Issues > Reductionism/Holism
Date: 25 November 2021
URI: https://philsci-archive.pitt.edu/id/eprint/21475

Monthly Views for the past 3 years

Monthly Downloads for the past 3 years

Plum Analytics

Actions (login required)

View Item View Item