PhilSci Archive

Model-Selection Theory: The Need for a More Nuanced Picture of Use-Novelty and Double-Counting

Steele, Katie and Werndl, Charlotte (2015) Model-Selection Theory: The Need for a More Nuanced Picture of Use-Novelty and Double-Counting. [Preprint]

[img] PDF
ModelSelectionFinal_FinalSubmission2.pdf

Download (294kB)

Abstract

This paper argues that common intuitions regarding a) the specialness of "use-novel" data for confirmation, and b) that this specialness implies the "no-double-counting rule", which says that data used in "constructing" (calibrating) a model cannot also play a role in confirming the model's predictions, are too crude. The intuitions in question are pertinent in all the sciences, but we appeal to a climate science case study to illustrate what is at stake. Our strategy is to analyse the intuitive claims in light of prominent accounts of confirmation of model predictions. We show that, on the Bayesian account of confirmation, and also on the standard Classical hypothesis-testing account, claims a) and b) are not generally true, but for some select cases, it is possible to distinguish data used for calibration from use-novel data, where only the latter confirm. The more specialised Classical model-selection methods, on the other hand, uphold a nuanced version of claim a), but this comes apart from b), which must be rejected in favour of a more refined account of the relationship between calibration and confirmation. Thus, depending on the framework of confirmation, either the scope or the simplicity of the intuitive position must be revised.


Export/Citation: EndNote | BibTeX | Dublin Core | ASCII/Text Citation (Chicago) | HTML Citation | OpenURL
Social Networking:
Share |

Item Type: Preprint
Creators:
CreatorsEmailORCID
Steele, Katiek.steele@lse.ac.uk
Werndl, Charlottecharlotte.werndl@sbg.ac.at
Additional Information: Forthcoming in: The British Journal for the Philosophy of Science
Keywords: model selection theory, use-novelty, double-counting, confirmation, calibration, evidence, philosophy of statistics, philosophy of climate science
Subjects: General Issues > Confirmation/Induction
Specific Sciences > Earth Sciences
Specific Sciences > Probability/Statistics
General Issues > Science and Policy
Depositing User: Charlotte Werndl
Date Deposited: 30 Nov 2015 13:33
Last Modified: 30 Nov 2015 13:33
Item ID: 11784
Subjects: General Issues > Confirmation/Induction
Specific Sciences > Earth Sciences
Specific Sciences > Probability/Statistics
General Issues > Science and Policy
Date: 2015
URI: https://philsci-archive.pitt.edu/id/eprint/11784

Monthly Views for the past 3 years

Monthly Downloads for the past 3 years

Plum Analytics

Actions (login required)

View Item View Item