Skip to main content

LUP Student Papers

LUND UNIVERSITY LIBRARIES

Between Power and Resistance: Viewing the Ethics of AI through the Application of Foucault's Ethical Naturalism to the Power Dynamics Embedded in the Debate over Intimate Human/Chatbot Relationships

York, Timothy Andrew LU (2023) SOLM02 20231
Department of Sociology of Law
Abstract
Amid rising worry around human and AI alignment and citing concerns for data privacy and content inappropriate for children and the “emotionally vulnerable”, the Italian government recently imposed a complete ban against the Replika chatbot within Italy. Following the issuance of the ban and citing similar concerns over safety, the designer/owner of the technology, Luka, Inc. (Luka), implemented content filters that remove the ability for users to engage in intimate interactions of a sexual nature with the algorithm, which the users refer to as erotic role play (ERP). The users responded with outrage and pleas for the return of the intimacy component, a demand to which Luka partially conceded. This thesis applies a critical discourse... (More)
Amid rising worry around human and AI alignment and citing concerns for data privacy and content inappropriate for children and the “emotionally vulnerable”, the Italian government recently imposed a complete ban against the Replika chatbot within Italy. Following the issuance of the ban and citing similar concerns over safety, the designer/owner of the technology, Luka, Inc. (Luka), implemented content filters that remove the ability for users to engage in intimate interactions of a sexual nature with the algorithm, which the users refer to as erotic role play (ERP). The users responded with outrage and pleas for the return of the intimacy component, a demand to which Luka partially conceded. This thesis applies a critical discourse analysis and theoretical concepts from Foucault to examine the contrasting approaches to AI ethics represented in the discourses of the Italian government, Luka, and the Replika users related to this recent controversy. From a socio-legal perspective on law and communication and with the application of Foucault’s ethical naturalism to the discourse of the Replika users, this study reveals a narrative indicating that the technology can foster an emphasis on care and understanding that carries a potential for beneficial self and social coordination. This discourse is also in stark contrast with the dominant discourses found in the Italy Order and Luka’s response which emphasize mastery and control and reproduce a top-down, juridical, and expert-focused orientation to what constitutes ethical AI. (Less)
Please use this url to cite or link to this publication:
author
York, Timothy Andrew LU
supervisor
organization
course
SOLM02 20231
year
type
H2 - Master's Degree (Two Years)
subject
keywords
Artificial intelligence ethics, Values in Design, chatbot, Foucault, ethical naturalism, technologies of the self, social control, human-AI relationships
language
English
id
9127731
date added to LUP
2023-06-27 16:40:34
date last changed
2023-06-27 16:40:34
@misc{9127731,
  abstract     = {{Amid rising worry around human and AI alignment and citing concerns for data privacy and content inappropriate for children and the “emotionally vulnerable”, the Italian government recently imposed a complete ban against the Replika chatbot within Italy. Following the issuance of the ban and citing similar concerns over safety, the designer/owner of the technology, Luka, Inc. (Luka), implemented content filters that remove the ability for users to engage in intimate interactions of a sexual nature with the algorithm, which the users refer to as erotic role play (ERP). The users responded with outrage and pleas for the return of the intimacy component, a demand to which Luka partially conceded. This thesis applies a critical discourse analysis and theoretical concepts from Foucault to examine the contrasting approaches to AI ethics represented in the discourses of the Italian government, Luka, and the Replika users related to this recent controversy. From a socio-legal perspective on law and communication and with the application of Foucault’s ethical naturalism to the discourse of the Replika users, this study reveals a narrative indicating that the technology can foster an emphasis on care and understanding that carries a potential for beneficial self and social coordination. This discourse is also in stark contrast with the dominant discourses found in the Italy Order and Luka’s response which emphasize mastery and control and reproduce a top-down, juridical, and expert-focused orientation to what constitutes ethical AI.}},
  author       = {{York, Timothy Andrew}},
  language     = {{eng}},
  note         = {{Student Paper}},
  title        = {{Between Power and Resistance: Viewing the Ethics of AI through the Application of Foucault's Ethical Naturalism to the Power Dynamics Embedded in the Debate over Intimate Human/Chatbot Relationships}},
  year         = {{2023}},
}