The Artificial Lyricist : Prototyping an Interactive Opera for Humans and Machines
Jalhed, Hedvig LU
; Rylander, Mattias
and Åberg, Kristoffer
(2023)
p.831-847
- Abstract
- To probe into the artistic possibilities of Artificial Intelligence (AI) generating operatic elements, we have engaged in a practice-led inquiry as designers and artists. We took the process of prototyping a chamber opera with interactive features as our starting point, exploring how AI could work as a source of stimuli in opera productions, and how prototyping might add to the design and evaluation of AI integrated into an operatic context. Our core idea was to use AI to generate personalized lyrics in a dynamic opera libretto, based on input to the AI from individual visitors attending the operatic event. In response to visitors, the opera singer read and rendered the AI-generated text artistically in real-time and in a karaoke-like... (More)
- To probe into the artistic possibilities of Artificial Intelligence (AI) generating operatic elements, we have engaged in a practice-led inquiry as designers and artists. We took the process of prototyping a chamber opera with interactive features as our starting point, exploring how AI could work as a source of stimuli in opera productions, and how prototyping might add to the design and evaluation of AI integrated into an operatic context. Our core idea was to use AI to generate personalized lyrics in a dynamic opera libretto, based on input to the AI from individual visitors attending the operatic event. In response to visitors, the opera singer read and rendered the AI-generated text artistically in real-time and in a karaoke-like manner in accordance with the musical framework and the embodiment of the operatic character. Hence, the concept comprised both human-to-machine, machine-to-human, and human-to-human interaction. While some design elements stimulated the participating opera visitors, others stimulated the performing opera singer, supported by an informational framework composed verbally through a prototypical manuscript, audially through a prototypical accompaniment, and visually through a prototypical setting. The prototype was play-tested and evaluated in relation to our artistic intentions. The AI-based prototype added parameters to the artistic process such as sketching narrow AI for the operatic format and evaluating articulated qualities. Furthermore, we suggest that the conceptual artwork can be seen as an example of a contemporary turn in operatic evolution, with human performers forging not only bodily, but also intellectual relationships with machines. (Less)
Please use this url to cite or link to this publication:
https://lup.lub.lu.se/record/735e5325-3f83-419b-98dc-04ccc05ef561
- author
- Jalhed, Hedvig
LU
; Rylander, Mattias
and Åberg, Kristoffer
- publishing date
- 2023
- type
- Chapter in Book/Report/Conference proceeding
- publication status
- published
- subject
- keywords
- interaction design, chamber opera, artificial intelligence, generative text, prototyping
- host publication
- From Abstractness to Concreteness : Experiential Knowledge and the Role of Prototypes in Design Research - Experiential Knowledge and the Role of Prototypes in Design Research
- editor
- Ferraris, Silvia ; Rognoli, Valentina and Nimkulrat, Nithikul
- pages
- 17 pages
- ISBN
- 9788894167436
- language
- Swedish
- LU publication?
- no
- id
- 735e5325-3f83-419b-98dc-04ccc05ef561
- alternative location
- https://www.eksig2023.polimi.it/assets/EKSIG-Proceedings.pdf
- date added to LUP
- 2024-01-08 22:20:01
- date last changed
- 2024-01-11 09:44:07
@inproceedings{735e5325-3f83-419b-98dc-04ccc05ef561,
abstract = {{To probe into the artistic possibilities of Artificial Intelligence (AI) generating operatic elements, we have engaged in a practice-led inquiry as designers and artists. We took the process of prototyping a chamber opera with interactive features as our starting point, exploring how AI could work as a source of stimuli in opera productions, and how prototyping might add to the design and evaluation of AI integrated into an operatic context. Our core idea was to use AI to generate personalized lyrics in a dynamic opera libretto, based on input to the AI from individual visitors attending the operatic event. In response to visitors, the opera singer read and rendered the AI-generated text artistically in real-time and in a karaoke-like manner in accordance with the musical framework and the embodiment of the operatic character. Hence, the concept comprised both human-to-machine, machine-to-human, and human-to-human interaction. While some design elements stimulated the participating opera visitors, others stimulated the performing opera singer, supported by an informational framework composed verbally through a prototypical manuscript, audially through a prototypical accompaniment, and visually through a prototypical setting. The prototype was play-tested and evaluated in relation to our artistic intentions. The AI-based prototype added parameters to the artistic process such as sketching narrow AI for the operatic format and evaluating articulated qualities. Furthermore, we suggest that the conceptual artwork can be seen as an example of a contemporary turn in operatic evolution, with human performers forging not only bodily, but also intellectual relationships with machines.}},
author = {{Jalhed, Hedvig and Rylander, Mattias and Åberg, Kristoffer}},
booktitle = {{From Abstractness to Concreteness : Experiential Knowledge and the Role of Prototypes in Design Research}},
editor = {{Ferraris, Silvia and Rognoli, Valentina and Nimkulrat, Nithikul}},
isbn = {{9788894167436}},
keywords = {{interaction design; chamber opera; artificial intelligence; generative text; prototyping}},
language = {{swe}},
pages = {{831--847}},
title = {{The Artificial Lyricist : Prototyping an Interactive Opera for Humans and Machines}},
url = {{https://lup.lub.lu.se/search/files/168626157/EKSIG-Proceedings.pdf}},
year = {{2023}},
}