The perceptual effects of manipulating nonlinear phenomena in synthetic nonverbal vocalizations
Anikin, Andrey LU
(2020)
In Bioacoustics
29(2).
p.226-247
- Abstract
- The communicative role of nonlinear vocal phenomena remains poorly understood since they are difficult to manipulate or even measure with conventional tools. In this study parametric voice synthesis was employed to add pitch jumps, subharmonics/sidebands, and chaos to synthetic human nonverbal vocalizations. In Experiment 1 (86 participants, 144 sounds), chaos was associated with lower valence, and subharmonics with higher dominance. Arousal ratings were not noticeably affected by any nonlinear effects, except for a marginal effect of subharmonics. These findings were extended in Experiment 2 (83 participants, 212 sounds) using ratings on discrete emotions. Listeners associated pitch jumps, subharmonics, and especially chaos with aversive... (More)
- The communicative role of nonlinear vocal phenomena remains poorly understood since they are difficult to manipulate or even measure with conventional tools. In this study parametric voice synthesis was employed to add pitch jumps, subharmonics/sidebands, and chaos to synthetic human nonverbal vocalizations. In Experiment 1 (86 participants, 144 sounds), chaos was associated with lower valence, and subharmonics with higher dominance. Arousal ratings were not noticeably affected by any nonlinear effects, except for a marginal effect of subharmonics. These findings were extended in Experiment 2 (83 participants, 212 sounds) using ratings on discrete emotions. Listeners associated pitch jumps, subharmonics, and especially chaos with aversive states such as fear and pain. The effects of manipulations in both experiments were particularly strong for ambiguous vocalizations, such as moans and gasps, and could not be explained by a non-specific measure of spectral noise (harmonics-to-noise ratio) – that is, they would be missed by a conventional acoustic analysis. In conclusion, listeners interpret nonlinear vocal phenomena quite flexibly, depending on their type and the kind of vocalization in which they occur. These results showcase the utility of parametric voice synthesis and highlight the need for a more fine-grained analysis of voice quality in acoustic research. (Less)
Please use this url to cite or link to this publication:
https://lup.lub.lu.se/record/c00a9e34-256f-41ad-802f-ba7f04549728
- author
- Anikin, Andrey
LU
- organization
- publishing date
- 2020
- type
- Contribution to journal
- publication status
- published
- subject
- keywords
- Nonlinear phenomena, source spectrum, human nonverbal vocalizations, voice synthesis, emotion
- in
- Bioacoustics
- volume
- 29
- issue
- 2
- pages
- 22 pages
- publisher
- Taylor & Francis
- external identifiers
-
- scopus:85078432499
- ISSN
- 0952-4622
- DOI
- 10.1080/09524622.2019.1581839
- language
- English
- LU publication?
- yes
- id
- c00a9e34-256f-41ad-802f-ba7f04549728
- date added to LUP
- 2019-03-12 08:25:42
- date last changed
- 2022-04-25 21:37:07
@article{c00a9e34-256f-41ad-802f-ba7f04549728,
abstract = {{The communicative role of nonlinear vocal phenomena remains poorly understood since they are difficult to manipulate or even measure with conventional tools. In this study parametric voice synthesis was employed to add pitch jumps, subharmonics/sidebands, and chaos to synthetic human nonverbal vocalizations. In Experiment 1 (86 participants, 144 sounds), chaos was associated with lower valence, and subharmonics with higher dominance. Arousal ratings were not noticeably affected by any nonlinear effects, except for a marginal effect of subharmonics. These findings were extended in Experiment 2 (83 participants, 212 sounds) using ratings on discrete emotions. Listeners associated pitch jumps, subharmonics, and especially chaos with aversive states such as fear and pain. The effects of manipulations in both experiments were particularly strong for ambiguous vocalizations, such as moans and gasps, and could not be explained by a non-specific measure of spectral noise (harmonics-to-noise ratio) – that is, they would be missed by a conventional acoustic analysis. In conclusion, listeners interpret nonlinear vocal phenomena quite flexibly, depending on their type and the kind of vocalization in which they occur. These results showcase the utility of parametric voice synthesis and highlight the need for a more fine-grained analysis of voice quality in acoustic research.}},
author = {{Anikin, Andrey}},
issn = {{0952-4622}},
keywords = {{Nonlinear phenomena; source spectrum; human nonverbal vocalizations; voice synthesis; emotion}},
language = {{eng}},
number = {{2}},
pages = {{226--247}},
publisher = {{Taylor & Francis}},
series = {{Bioacoustics}},
title = {{The perceptual effects of manipulating nonlinear phenomena in synthetic nonverbal vocalizations}},
url = {{http://dx.doi.org/10.1080/09524622.2019.1581839}},
doi = {{10.1080/09524622.2019.1581839}},
volume = {{29}},
year = {{2020}},
}