How to analyse and manipulate nonlinear phenomena in voice recordings
Anikin, Andrey LU
and Herbst, Christian T.
(2025)
In Philosophical Transactions of the Royal Society B: Biological Sciences
- Abstract
- We address two research applications in this methodological review: starting from an audio recording, the goal may be to characterize nonlinear phenomena (NLP) at the level of voice production or to test their perceptual effects on listeners. A crucial prerequisite for this work is the ability to detect NLP in acoustic signals, which can then be correlated with biologically relevant information about the caller and with listeners’ reaction. NLP are often annotated manually, but this is labour-intensive and not very reliable, although we describe potentially helpful advanced visualization aids such as reassigned spectrograms and phasegrams. Objective acoustic features can also be useful, including general descriptives (harmonics-to-noise... (More)
- We address two research applications in this methodological review: starting from an audio recording, the goal may be to characterize nonlinear phenomena (NLP) at the level of voice production or to test their perceptual effects on listeners. A crucial prerequisite for this work is the ability to detect NLP in acoustic signals, which can then be correlated with biologically relevant information about the caller and with listeners’ reaction. NLP are often annotated manually, but this is labour-intensive and not very reliable, although we describe potentially helpful advanced visualization aids such as reassigned spectrograms and phasegrams. Objective acoustic features can also be useful, including general descriptives (harmonics-to-noise ratio, cepstral peak prominence, vocal roughness), statistics derived from nonlinear dynamics (correlation dimension) and NLP-specific measures (depth of modulation and subharmonics). On the perception side, playback studies can greatly benefit from tools for directly manipulating NLP in recordings. Adding frequency jumps, amplitude modulation and subharmonics is relatively straightforward. Creating biphonation, imitating chaos or removing NLP from a recording are more challenging, but feasible with parametric voice synthesis. We describe the most promising algorithms for analysing and manipulating NLP and provide detailed examples with audio files and R code in supplementary material.
This article is part of the theme issue ‘Nonlinear phenomena in vertebrate vocalizations: mechanisms and communicative functions’. (Less)
Please use this url to cite or link to this publication:
https://lup.lub.lu.se/record/b216ebe5-af3a-46d9-ba73-9ced2bc0cec6
- author
- Anikin, Andrey
LU
and Herbst, Christian T.
- organization
- publishing date
- 2025
- type
- Contribution to journal
- publication status
- published
- subject
- keywords
- voice, vocal communication, nonlinear phenomena, acoustic analysis, voice synthesis
- in
- Philosophical Transactions of the Royal Society B: Biological Sciences
- publisher
- Royal Society Publishing
- external identifiers
-
- pmid:40176526
- scopus:105001835245
- ISSN
- 1471-2970
- DOI
- 10.1098/rstb.2024.0003
- language
- English
- LU publication?
- yes
- id
- b216ebe5-af3a-46d9-ba73-9ced2bc0cec6
- date added to LUP
- 2025-04-03 18:20:34
- date last changed
- 2025-04-28 04:01:27
@article{b216ebe5-af3a-46d9-ba73-9ced2bc0cec6,
abstract = {{We address two research applications in this methodological review: starting from an audio recording, the goal may be to characterize nonlinear phenomena (NLP) at the level of voice production or to test their perceptual effects on listeners. A crucial prerequisite for this work is the ability to detect NLP in acoustic signals, which can then be correlated with biologically relevant information about the caller and with listeners’ reaction. NLP are often annotated manually, but this is labour-intensive and not very reliable, although we describe potentially helpful advanced visualization aids such as reassigned spectrograms and phasegrams. Objective acoustic features can also be useful, including general descriptives (harmonics-to-noise ratio, cepstral peak prominence, vocal roughness), statistics derived from nonlinear dynamics (correlation dimension) and NLP-specific measures (depth of modulation and subharmonics). On the perception side, playback studies can greatly benefit from tools for directly manipulating NLP in recordings. Adding frequency jumps, amplitude modulation and subharmonics is relatively straightforward. Creating biphonation, imitating chaos or removing NLP from a recording are more challenging, but feasible with parametric voice synthesis. We describe the most promising algorithms for analysing and manipulating NLP and provide detailed examples with audio files and R code in supplementary material.<br/><br/>This article is part of the theme issue ‘Nonlinear phenomena in vertebrate vocalizations: mechanisms and communicative functions’.}},
author = {{Anikin, Andrey and Herbst, Christian T.}},
issn = {{1471-2970}},
keywords = {{voice; vocal communication; nonlinear phenomena; acoustic analysis; voice synthesis}},
language = {{eng}},
publisher = {{Royal Society Publishing}},
series = {{Philosophical Transactions of the Royal Society B: Biological Sciences}},
title = {{How to analyse and manipulate nonlinear phenomena in voice recordings}},
url = {{http://dx.doi.org/10.1098/rstb.2024.0003}},
doi = {{10.1098/rstb.2024.0003}},
year = {{2025}},
}