PhilSci Archive

The Use and Misuse of Counterfactuals in Ethical Machine Learning

Kasirzadeh, Atoosa and Smart, Andrew (2021) The Use and Misuse of Counterfactuals in Ethical Machine Learning. FAccT '21: Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency.

[img]
Preview
Text
3442188.3445886.pdf

Download (180kB) | Preview

Abstract

The use of counterfactuals for considerations of algorithmic fairness and explainability is gaining prominence within the machine learning community and industry. This paper argues for more caution with the use of counterfactuals when the facts to be considered are social categories such as race or gender. We review a broad body of papers from philosophy and social sciences on social ontology and the semantics of counterfactuals, and we conclude that the counterfactual approach in machine learning fairness and social explainability can require an incoherent theory of what social categories are. Our findings suggest that most often the social categories may not admit counterfactual manipulation, and hence may not appropriately satisfy the demands for evaluating the truth or falsity of counterfactuals. This is important because the widespread use of counterfactuals in machine learning can lead to misleading results when applied in high-stakes domains. Accordingly, we argue that even though counterfactuals play an essential part in some causal inferences, their use for questions of algorithmic fairness and social explanations can create more problems than they resolve. Our positive result is a set of tenets about using counterfactuals for fairness and explanations in machine learning.


Export/Citation: EndNote | BibTeX | Dublin Core | ASCII/Text Citation (Chicago) | HTML Citation | OpenURL
Social Networking:
Share |

Item Type: Published Article or Volume
Creators:
CreatorsEmailORCID
Kasirzadeh, Atoosaatoosa.kasirzadeh@mail.utoronto.ca
Smart, Andrewandrewsmart@google.com
Keywords: Counterfactuals Machine learning Ethics and AI Ethical AI
Subjects: Specific Sciences > Artificial Intelligence > AI and Ethics
Depositing User: Dr. Atoosa Kasirzadeh
Date Deposited: 08 Sep 2021 03:57
Last Modified: 08 Sep 2021 03:57
Item ID: 19538
Journal or Publication Title: FAccT '21: Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency
Publisher: FAccT '21: Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency
Official URL: https://dl.acm.org/doi/10.1145/3442188.3445886
DOI or Unique Handle: https://doi.org/10.1145/3442188.3445886
Subjects: Specific Sciences > Artificial Intelligence > AI and Ethics
Date: 2021
URI: https://philsci-archive.pitt.edu/id/eprint/19538

Monthly Views for the past 3 years

Monthly Downloads for the past 3 years

Plum Analytics

Altmetric.com

Actions (login required)

View Item View Item