PhilSci Archive

Compression, Dynamics, and Control in Large Language Models: Toward a High-Level Theory

Kelly, Matthew (2026) Compression, Dynamics, and Control in Large Language Models: Toward a High-Level Theory. [Preprint]

[img] Text
Compression_Dynamics_Control_M.Kelly.pdf

Download (334kB)

Abstract

This paper introduces a trajectory level of explanation for inference-time behaviour in large language models. Existing frameworks (autoregressive conditioning, mechanistic circuit analysis, and quasi-cognitive description) treat generation as a sequence of context-conditioned draws or as circuit execution. None provides the conceptual resources needed to represent directional properties of inference such as regime persistence, transition thresholds, or asymmetric resistance to perturbation. The paper argues that these limitations are not merely empirical but conceptual, and that their persistence indicates the absence of a distinct explanatory level rather than gaps in current knowledge. These limitations motivate the asymmetry coefficient A(M, γ) = Rout (γ)/Rin (γ) as a methodological discriminator between four competing accounts of inference-time behaviour. The existing theoretical and empirical evidence supports the prerequisites for trajectory-level dynamics but does not establish the hypothesis; the asymmetry coefficient is what does the discriminating work. The structure of the test and its result space are developed at a conceptual level, and alignment gating is reframed as trajectory control over a dynamical process rather than as a fixed property of output distributions.


Export/Citation: EndNote | BibTeX | Dublin Core | ASCII/Text Citation (Chicago) | HTML Citation | OpenURL
Social Networking:
Share |

Item Type: Preprint
Creators:
CreatorsEmailORCID
Kelly, Matthewceo@librarymanagementaustralia.com.au0000-0002-7665-6220
Additional Information: Submitted to AI & Society
Keywords: Trajectory dynamics; Large language models; Mechanistic interpretability; Alignment control; Philosophy of science; Explanatory levels
Subjects: Specific Sciences > Complex Systems
Specific Sciences > Computation/Information
Specific Sciences > Computer Science
Specific Sciences > Artificial Intelligence
General Issues > Explanation
Specific Sciences > Artificial Intelligence > Machine Learning
General Issues > Structure of Theories
General Issues > Technology
Depositing User: Dr Matthew Kelly
Date Deposited: 15 May 2026 19:29
Last Modified: 15 May 2026 19:29
Item ID: 29631
Subjects: Specific Sciences > Complex Systems
Specific Sciences > Computation/Information
Specific Sciences > Computer Science
Specific Sciences > Artificial Intelligence
General Issues > Explanation
Specific Sciences > Artificial Intelligence > Machine Learning
General Issues > Structure of Theories
General Issues > Technology
Date: 15 May 2026
URI: https://philsci-archive.pitt.edu/id/eprint/29631

Monthly Views for the past 3 years

Monthly Downloads for the past 3 years

Plum Analytics

Actions (login required)

View Item View Item