Gopnik, Alison (2024) Empowerment Gain as Causal Learning, Causal Learning as Empowerment Gain: A bridge between Bayesian causal hypothesis testing and reinforcement learning. Presented at the 29th Meeting of The Philosophy of Science Association, New Orleans, Dec 2024. In: UNSPECIFIED.
This is the latest version of this item.
![[img]](https://philsci-archive.pitt.edu/style/images/fileicons/text.png) |
Text
Gopnik Empowerment as Causal Learning Final.docx Download (37kB) |
Abstract
Learning about the causal structure of the world is a fundamental problem for human cognition, and causal knowledge is central to both intuitive and scientific theories. Cognitive scientists have applied advances in our formal understanding of causation in philosophy and computer science, particularly within the Causal Bayes Net formalism, to understand human causal learning. In parallel, in the very different tradition of reinforcement learning, researchers have developed the idea of an intrinsic reward signal called “empowerment”. An agent is rewarded for maximizing the mutual information between its actions and their outcomes, regardless of the external reward value of those outcomes. In other words, the agent is rewarded if variation in an action systematically leads to parallel variation in an outcome so that variation in the action predicts variation in the outcome. The result is an agent that has maximal control over its environment. I argue that “empowerment” may be an important bridge between classical Bayesian causal learning and reinforcement learning and may help to characterize causal learning in humans and enable it in machines. More strongly, I make the philosophical argument that causal learning and empowerment gain are very closely related conceptually. If an agent learns an accurate causal model of the world they will necessarily increase their empowerment, and, vice versa, increasing empowerment will lead to a more accurate (if implicit) causal model of the world. This has implications for both accounts of causal learning in cognitive science and AI and for the metaphysics of causation. Empowerment may also explain distinctive empirical features of children’s causal learning, as well as providing a more tractable computational account of how that learning is possible
| Export/Citation: | EndNote | BibTeX | Dublin Core | ASCII/Text Citation (Chicago) | HTML Citation | OpenURL |
| Social Networking: |
Available Versions of this Item
-
Empowerment as Causal Learning, Causal Learning as Empowerment: A bridge between Bayesian causal hypothesis testing and reinforcement learning. (deposited 07 Apr 2024 05:10)
- Empowerment Gain as Causal Learning, Causal Learning as Empowerment Gain: A bridge between Bayesian causal hypothesis testing and reinforcement learning. Presented at the 29th Meeting of The Philosophy of Science Association, New Orleans, Dec 2024. (deposited 02 Jan 2025 14:22) [Currently Displayed]
Monthly Views for the past 3 years
Monthly Downloads for the past 3 years
Plum Analytics
Actions (login required)
 |
View Item |
![[feed]](http://philsci-archive.pitt.edu/style/images/feed-icon-32x32.png){kind=icon}