PhilSci Archive

Understanding Is Not a Scalar: What the Chinese Room Could Not Imagine

Chang-Eop, Kim (2026) Understanding Is Not a Scalar: What the Chinese Room Could Not Imagine. [Preprint]

[img] Text
chinese_room_paper.pdf

Download (926kB)

Abstract

Searle's Chinese Room argument derives its persuasive force from a specific implementation image: a person following a static rulebook of symbol-manipulation rules. The ``stochastic parrots'' critique revived the same intuition for contemporary systems. We argue that this line of argument constitutes an implementation-dependent thought experiment---one whose intuitive force diminishes when its implementation premises change. Two premises underlying the original image---static symbolic manipulation and internal opacity---are violated in significant respects by modern learning systems. Models trained on different modalities and domains converge toward shared representational geometries, and within individual models, non-spatial inputs give rise to geometric representations that mirror known structures of the domain. Large language models exhibit concept-selective self-reports causally grounded in internal activation states. These findings do not prove understanding exists, but establish that the system image presupposed by the Chinese Room no longer describes how modern systems operate. We propose a multi-dimensional framework that decomposes understanding into three conceptually separable dimensions: structural (capturing world structure in representational geometry), self-modeling (causally grounded access to internal states), and phenomenal (subjective experience). Under this framework, the Chinese Room's conclusion is valid for systems matching its implementation profile---high phenomenal experience but near-zero structural capture and self-modeling---yet this profile no longer applies to modern learning systems, and the ``stochastic parrot'' characterization is revealed to conflate absence on one dimension with absence on all. The question becomes which dimensions of understanding contemporary learning systems instantiate, and which remain genuinely open.


Export/Citation: EndNote | BibTeX | Dublin Core | ASCII/Text Citation (Chicago) | HTML Citation | OpenURL
Social Networking:
Share |

Item Type: Preprint
Creators:
CreatorsEmailORCID
Chang-Eop, Kimeopchang@gmail.com0000-0001-8281-9148
Keywords: Chinese Room argument, Stochastic parrots, Representational convergence, Functional introspection, Implementation-dependent thought experiments, Philosophy of AI
Subjects: Specific Sciences > Artificial Intelligence
Depositing User: Dr. Chang-Eop Kim
Date Deposited: 26 Feb 2026 12:09
Last Modified: 26 Feb 2026 12:09
Item ID: 28365
Subjects: Specific Sciences > Artificial Intelligence
Date: 26 February 2026
URI: https://philsci-archive.pitt.edu/id/eprint/28365

Monthly Views for the past 3 years

Monthly Downloads for the past 3 years

Plum Analytics

Actions (login required)

View Item View Item