Poldrack, Russell A. (2020) The physics of representation. [Preprint]
This is the latest version of this item.
|
Text
PhysicsOfRepresentation.pdf - Submitted Version Available under License Creative Commons Attribution. Download (8MB) | Preview |
Abstract
The concept of “representation” is used broadly and uncontroversially throughout neuroscience, in contrast to its highly controversial status within the philosophy of mind and cognitive science. In this paper I first discuss the way that the term is used within neuroscience, in particular describing the strategies by which representations are characterized empirically. I then relate the concept of representation within neuroscience to one that has developed within the field of machine learning (in particular through recent work in deep learning or “representation learning”). I argue that the recent success of artificial neural networks on certain tasks such as visual object recognition reflects the degree to which those systems (like biological brains) exhibit inherent inductive biases that reflect on the structure of the physical world. I further argue that any system that is going to behave intelligently in the world must contain representations that reflect the structure of the world; otherwise, the system must perform unconstrained function approximation which is destined to fail due to the curse of dimensionality, in which the number of possible states of the world grows exponentially with the number of dimensions in the space of possible inputs. An analysis of these concepts in light of philosophical debates regarding the ontological status of representations suggests that the representations identified within both biological and artificial neural networks qualify as first-class representations.
| Export/Citation: | EndNote | BibTeX | Dublin Core | ASCII/Text Citation (Chicago) | HTML Citation | OpenURL |
| Social Networking: |
| Item Type: | Preprint | ||||||
|---|---|---|---|---|---|---|---|
| Creators: |
|
||||||
| Keywords: | representation, machine learning, inductive bias | ||||||
| Subjects: | Specific Sciences > Neuroscience > Cognitive Neuroscience Specific Sciences > Computer Science General Issues > Computer Simulation Specific Sciences > Cognitive Science > Concepts and Representations Specific Sciences > Neuroscience > Systems Neuroscience |
||||||
| Depositing User: | Dr Russell Poldrack | ||||||
| Date Deposited: | 11 Jul 2020 03:25 | ||||||
| Last Modified: | 11 Jul 2020 03:25 | ||||||
| Item ID: | 17455 | ||||||
| Subjects: | Specific Sciences > Neuroscience > Cognitive Neuroscience Specific Sciences > Computer Science General Issues > Computer Simulation Specific Sciences > Cognitive Science > Concepts and Representations Specific Sciences > Neuroscience > Systems Neuroscience |
||||||
| Date: | 2020 | ||||||
| URI: | https://philsci-archive.pitt.edu/id/eprint/17455 |
Available Versions of this Item
-
The physics of representation. (deposited 16 Feb 2020 16:45)
- The physics of representation. (deposited 11 Jul 2020 03:25) [Currently Displayed]
Monthly Views for the past 3 years
Monthly Downloads for the past 3 years
Plum Analytics
Actions (login required)
 |
View Item |
![[feed]](http://philsci-archive.pitt.edu/style/images/feed-icon-32x32.png){kind=icon}