PhilSci Archive

Against AI Understanding and Sentience: Large Language Models, Meaning, and the Patterns of Human Language Use

Durt, Christoph and Froese, Tom and Fuchs, Thomas (2023) Against AI Understanding and Sentience: Large Language Models, Meaning, and the Patterns of Human Language Use. [Preprint]

WarningThere is a more recent version of this item available.
[img]
Preview
Text
Durt, Christoph,Froese, Tom,Fuchs, Thomas 2023 LLMs.pdf - Draft Version

Download (297kB) | Preview

Abstract

Large language models such as ChatGPT are deep learning architectures trained on immense quantities of text. Their capabilities of producing human-like text are often attributed either to mental capacities or the modeling of such capacities. This paper argues, to the contrary, that because much of meaning is embedded in common patterns of language use, LLMs can model the statistical contours of these usage patterns. We agree with distributional semantics that the statistical relations of a text corpus reflect meaning, but only part of it. Written words are only one part of language use, although an important one as it scaffolds our interactions and mental life. In human language production, preconscious anticipatory processes interact with conscious experience. Human language use constitutes and makes use of given patterns and at the same time constantly rearranges them in a way we compare to the creation of a collage. LLMs do not model sentience or other mental capacities of humans but the common patterns in public language use, clichés and biases included. They thereby highlight the surprising extent to which human language use gives rise to and is guided by patterns.


Export/Citation: EndNote | BibTeX | Dublin Core | ASCII/Text Citation (Chicago) | HTML Citation | OpenURL
Social Networking:
Share |

Item Type: Preprint
Creators:
CreatorsEmailORCID
Durt, ChristophChristoph@Durt.de0000-0002-2934-1875
Froese, Tomtom.froese@oist.jp0000-0002-9899-5274
Fuchs, ThomasThomas.Fuchs@urz.uni-heidelberg.de0000-0001-9466-4956
Keywords: AI, Large Language Models, distributional semantics, scaffolding, meaning, understanding
Subjects: Specific Sciences > Artificial Intelligence > Classical AI
Specific Sciences > Cognitive Science
Specific Sciences > Cognitive Science > Computation
Specific Sciences > Artificial Intelligence
Specific Sciences > Cognitive Science > Concepts and Representations
Specific Sciences > Cognitive Science > Consciousness
Specific Sciences > Artificial Intelligence > Machine Learning
Specific Sciences > Cognitive Science > Perception
Depositing User: Dr Christoph Durt
Date Deposited: 12 Apr 2023 13:16
Last Modified: 16 Oct 2023 17:32
Item ID: 21983
Subjects: Specific Sciences > Artificial Intelligence > Classical AI
Specific Sciences > Cognitive Science
Specific Sciences > Cognitive Science > Computation
Specific Sciences > Artificial Intelligence
Specific Sciences > Cognitive Science > Concepts and Representations
Specific Sciences > Cognitive Science > Consciousness
Specific Sciences > Artificial Intelligence > Machine Learning
Specific Sciences > Cognitive Science > Perception
Date: March 2023
URI: https://philsci-archive.pitt.edu/id/eprint/21983

Available Versions of this Item

Monthly Views for the past 3 years

Monthly Downloads for the past 3 years

Plum Analytics

Actions (login required)

View Item View Item