Dowe, David and Gardner, Steve and Oppy, Graham (2006) "Bayes Not Bust! Why Simplicity is no problem for Bayesians". [Preprint]
|
PDF
DoweGardnerOppy_draftBayesNotBust.pdf Download (330kB) |
Abstract
The advent of formal definitions of the simplicity of a theory has important implications for model selection. But what is the best way to define simplicity? Forster and Sober ([1994]) advocate the use of Akaike's Information Criterion (AIC), a non-Bayesian formalisation of the notion of simplicity. This forms an important part of their wider attack on Bayesianism in the philosophy of science. We defend a Bayesian alternative: the simplicity of a theory is to be characterised in terms of Wallace's Minimum Message Length (MML). We show that AIC is inadequate for many statistical problems where MML performs well. Whereas MML is always defined, AIC can be undefined. Whereas MML is not known ever to be statistically inconsistent, AIC can be. Even when defined and consistent, AIC performs worse than MML on small sample sizes. MML is statistically invariant under 1-to-1 re-parametrisation, thus avoiding a common criticism of Bayesian approaches. We also show that MML provides answers to many of Forster's objections to Bayesianism. Hence an important part of the attack on Bayesianism fails.
Export/Citation: | EndNote | BibTeX | Dublin Core | ASCII/Text Citation (Chicago) | HTML Citation | OpenURL |
Social Networking: |
Item Type: | Preprint | ||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Creators: |
|
||||||||||||
Additional Information: | Near-final draft, forthcoming in Brit J Philos Sci (BJPS). At the end of sec. 8 (Conclusion) on p 52 just before the appendices, this paper discusses a fundamental question/conjecture as to "whether only MML and closely related Bayesian methods can, in general, infer fully specified models with both statistical consistency and invariance". | ||||||||||||
Keywords: | Minimum Message Length, MML, Bayesianism, simplicity, inference, prediction, induction, statistical inference, statistical consistency, efficiency, model selection, point estimation, information theory, Akaike Information Criterion, AIC, predictive accuracy | ||||||||||||
Subjects: | General Issues > Decision Theory General Issues > Confirmation/Induction General Issues > Formal Learning Theory |
||||||||||||
Depositing User: | David L Dowe | ||||||||||||
Date Deposited: | 15 Aug 2006 | ||||||||||||
Last Modified: | 07 Oct 2010 15:14 | ||||||||||||
Item ID: | 2877 | ||||||||||||
Subjects: | General Issues > Decision Theory General Issues > Confirmation/Induction General Issues > Formal Learning Theory |
||||||||||||
Date: | August 2006 | ||||||||||||
URI: | https://philsci-archive.pitt.edu/id/eprint/2877 |
Monthly Views for the past 3 years
Monthly Downloads for the past 3 years
Plum Analytics
Actions (login required)
View Item |