Skip to main content

Lund University Publications

LUND UNIVERSITY LIBRARIES

DAVID : An open-source platform for real-time transformation of infra-segmental emotional cues in running speech

Rachman, Laura ; Liuni, Marco ; Arias, Pablo ; Lind, Andreas LU ; Johansson, Petter LU ; Hall, Lars LU ; Richardson, Daniel C. ; Watanabe, Katsumi ; Dubal, Stéphanie and Aucouturier, Jean-Julien (2018) In Behavior Research Methods 50(1). p.323-343
Abstract

We present an open-source software platform that transforms emotional cues expressed by speech signals using audio effects like pitch shifting, inflection, vibrato, and filtering. The emotional transformations can be applied to any audio file, but can also run in real time, using live input from a microphone, with less than 20-ms latency. We anticipate that this tool will be useful for the study of emotions in psychology and neuroscience, because it enables a high level of control over the acoustical and emotional content of experimental stimuli in a variety of laboratory situations, including real-time social situations. We present here results of a series of validation experiments aiming to position the tool against several... (More)

We present an open-source software platform that transforms emotional cues expressed by speech signals using audio effects like pitch shifting, inflection, vibrato, and filtering. The emotional transformations can be applied to any audio file, but can also run in real time, using live input from a microphone, with less than 20-ms latency. We anticipate that this tool will be useful for the study of emotions in psychology and neuroscience, because it enables a high level of control over the acoustical and emotional content of experimental stimuli in a variety of laboratory situations, including real-time social situations. We present here results of a series of validation experiments aiming to position the tool against several methodological requirements: that transformed emotions be recognized at above-chance levels, valid in several languages (French, English, Swedish, and Japanese) and with a naturalness comparable to natural speech.

(Less)
Please use this url to cite or link to this publication:
author
; ; ; ; ; ; ; ; and
organization
publishing date
type
Contribution to journal
publication status
published
subject
keywords
Emotional transformations, Infra-segmental cues, Nonverbal behavior, Real-time, Software, Voice
in
Behavior Research Methods
volume
50
issue
1
pages
323 - 343
publisher
Springer
external identifiers
  • scopus:85016981246
  • pmid:28374144
ISSN
1554-3528
DOI
10.3758/s13428-017-0873-y
language
English
LU publication?
yes
id
0af41daa-d9db-481f-b10f-0a6c41dc5736
date added to LUP
2017-05-02 08:57:49
date last changed
2024-06-23 16:08:56
@article{0af41daa-d9db-481f-b10f-0a6c41dc5736,
  abstract     = {{<p>We present an open-source software platform that transforms emotional cues expressed by speech signals using audio effects like pitch shifting, inflection, vibrato, and filtering. The emotional transformations can be applied to any audio file, but can also run in real time, using live input from a microphone, with less than 20-ms latency. We anticipate that this tool will be useful for the study of emotions in psychology and neuroscience, because it enables a high level of control over the acoustical and emotional content of experimental stimuli in a variety of laboratory situations, including real-time social situations. We present here results of a series of validation experiments aiming to position the tool against several methodological requirements: that transformed emotions be recognized at above-chance levels, valid in several languages (French, English, Swedish, and Japanese) and with a naturalness comparable to natural speech.</p>}},
  author       = {{Rachman, Laura and Liuni, Marco and Arias, Pablo and Lind, Andreas and Johansson, Petter and Hall, Lars and Richardson, Daniel C. and Watanabe, Katsumi and Dubal, Stéphanie and Aucouturier, Jean-Julien}},
  issn         = {{1554-3528}},
  keywords     = {{Emotional transformations; Infra-segmental cues; Nonverbal behavior; Real-time; Software; Voice}},
  language     = {{eng}},
  number       = {{1}},
  pages        = {{323--343}},
  publisher    = {{Springer}},
  series       = {{Behavior Research Methods}},
  title        = {{DAVID : An open-source platform for real-time transformation of infra-segmental emotional cues in running speech}},
  url          = {{http://dx.doi.org/10.3758/s13428-017-0873-y}},
  doi          = {{10.3758/s13428-017-0873-y}},
  volume       = {{50}},
  year         = {{2018}},
}