Devezer, Berna and Buzbas, Erkan (2021) Minimum Viable Experiment to Replicate. [Preprint]
|
Text
MVE.pdf Download (177kB) | Preview |
Abstract
Replication experiments purport to independently validate claims from previous research or provide some diagnostic evidence about their reliability. In practice, this value of replication experiments is often taken for granted. Our research shows that in replication experiments, practice often does not live up to theory. Most replication experiments in practice are confounded and their results multiply determined, hence uninterpretable. These results can be driven by the true data generating mechanism, issues present in the original experiment, discrepancies between the original and the replication experiment, new issues introduced in the replication experiment, or combinations of any of these factors. The answers we are looking for with regard to the true state of nature require a rigorous and meticulous investigative process of eliminating errors and singling out elementary or pure cases. In this paper, we introduce the idea of a minimum viable experiment that needs to be identified in practice for replication results to be clearly interpretable. Most experiments are not replication-ready and before striving to replicate a given result, we need theoretical precision or systematic exploration to discover empirical regularities.
Export/Citation: | EndNote | BibTeX | Dublin Core | ASCII/Text Citation (Chicago) | HTML Citation | OpenURL |
Social Networking: |
Item Type: | Preprint | |||||||||
---|---|---|---|---|---|---|---|---|---|---|
Creators: |
|
|||||||||
Keywords: | Replication, reproducibility, epistemic iteration, exploratory experimentation, idealized experiment, minimalism | |||||||||
Subjects: | General Issues > Experimentation General Issues > History of Philosophy of Science General Issues > Reductionism/Holism |
|||||||||
Depositing User: | Dr. Berna Devezer | |||||||||
Date Deposited: | 26 Nov 2022 23:02 | |||||||||
Last Modified: | 26 Nov 2022 23:02 | |||||||||
Item ID: | 21475 | |||||||||
Subjects: | General Issues > Experimentation General Issues > History of Philosophy of Science General Issues > Reductionism/Holism |
|||||||||
Date: | 25 November 2021 | |||||||||
URI: | https://philsci-archive.pitt.edu/id/eprint/21475 |
Monthly Views for the past 3 years
Monthly Downloads for the past 3 years
Plum Analytics
Actions (login required)
View Item |