Friederich, Simon (2023) Symbiosis, not alignment, as the goal for liberal democracies in the transition to artificial general intelligence. AI and Ethics.
![[img]](https://philsci-archive.pitt.edu/style/images/fileicons/text.png) |
Text
10.1007/s43681-023-00268-7 - Published Version Available under License Creative Commons Attribution. Download (324kB) |
Abstract
A transition to a world with artificial general intelligence (AGI) may occur within the next few decades. This transition may give rise to catastrophic risks from misaligned AGI, which have received a significant amount of attention, deservedly. Here I argue that AGI systems that are intent-aligned—they always try to do what their operators want them to do—would also create catastrophic risks, mainly due to the power that they concentrate on their operators. With time, that power would almost certainly be catastrophically exploited, potentially resulting in human extinction or permanent dystopia. I suggest that liberal democracies, if they decide to allow the development of AGI, may react to this threat by letting AGI take shape as an intergenerational social project, resulting in an arrangement where AGI is not intent-aligned but symbiotic with humans. I provide some tentative ideas on what the resulting arrangement may look like and consider what speaks for and what against aiming for intent-aligned AGI as an intermediate step.
| Export/Citation: | EndNote | BibTeX | Dublin Core | ASCII/Text Citation (Chicago) | HTML Citation | OpenURL |
| Social Networking: |
| Item Type: | Published Article or Volume | ||||||
|---|---|---|---|---|---|---|---|
| Creators: |
|
||||||
| Keywords: | Liberal democracies, artificial intelligence, alignment, symbiosis | ||||||
| Subjects: | Specific Sciences > Artificial Intelligence > AI and Ethics Specific Sciences > Artificial Intelligence General Issues > Science and Society |
||||||
| Depositing User: | Dr. Simon Friederich | ||||||
| Date Deposited: | 08 Nov 2023 00:03 | ||||||
| Last Modified: | 08 Nov 2023 00:03 | ||||||
| Item ID: | 22736 | ||||||
| Journal or Publication Title: | AI and Ethics | ||||||
| DOI or Unique Handle: | https://doi.org/10.1007/s43681-023-00268-7 | ||||||
| Subjects: | Specific Sciences > Artificial Intelligence > AI and Ethics Specific Sciences > Artificial Intelligence General Issues > Science and Society |
||||||
| Date: | 16 March 2023 | ||||||
| URI: | https://philsci-archive.pitt.edu/id/eprint/22736 |
Monthly Views for the past 3 years
Monthly Downloads for the past 3 years
Plum Analytics
Altmetric.com
Actions (login required)
 |
View Item |
![[feed]](http://philsci-archive.pitt.edu/style/images/feed-icon-32x32.png){kind=icon}