PhilSci Archive

Statistical Learning Theory and Occam's Razor: The Core Argument

Sterkenburg, Tom F. (2024) Statistical Learning Theory and Occam's Razor: The Core Argument. Minds and Machines.

This is the latest version of this item.

[img] Text
sltoccaerm.pdf - Accepted Version

Download (435kB)

Abstract

Statistical learning theory is often associated with the principle of Occam's razor, which recommends a simplicity preference in inductive inference. This paper distills the core argument for simplicity obtainable from statistical learning theory, built on the theory's central learning guarantee for the method of empirical risk minimization. This core means-ends argument is that a simpler hypothesis class or inductive model is better because it has better learning guarantees; however, these guarantees are model-relative and so the theoretical push towards simplicity is checked by our prior knowledge.


Export/Citation: EndNote | BibTeX | Dublin Core | ASCII/Text Citation (Chicago) | HTML Citation | OpenURL
Social Networking:
Share |

Item Type: Published Article or Volume
Creators:
CreatorsEmailORCID
Sterkenburg, Tom F.tom.sterkenburg@lmu.de0000-0002-4860-727X
Keywords: machine learning, Occam's razor, induction, statistical learning theory
Subjects: General Issues > Confirmation/Induction
General Issues > Formal Learning Theory
Specific Sciences > Artificial Intelligence > Machine Learning
Specific Sciences > Probability/Statistics
Depositing User: Mr Tom Sterkenburg
Date Deposited: 30 Nov 2024 13:02
Last Modified: 30 Nov 2024 13:02
Item ID: 24311
Journal or Publication Title: Minds and Machines
Official URL: https://link.springer.com/article/10.1007/s11023-0...
DOI or Unique Handle: 10.1007/s11023-024-09703-y
Subjects: General Issues > Confirmation/Induction
General Issues > Formal Learning Theory
Specific Sciences > Artificial Intelligence > Machine Learning
Specific Sciences > Probability/Statistics
Date: 2024
URI: https://philsci-archive.pitt.edu/id/eprint/24311

Available Versions of this Item

Monthly Views for the past 3 years

Monthly Downloads for the past 3 years

Plum Analytics

Altmetric.com

Actions (login required)

View Item View Item