Skip to main content

Lund University Publications

LUND UNIVERSITY LIBRARIES

Auditory vs. audiovisual prominence ratings of speech involving spontaneously produced head movements

Ambrazaitis, Gilbert ; Frid, Johan LU orcid and House, David (2022) 11th International Conference on Speech Prosody In Proceedings of the International Conference on Speech Prosody p.352-356
Abstract
Visual information can be integrated in prominence perception, but most available evidence stems from controlled experimental settings, often involving synthetic stimuli. The present study provides evidence from spontaneously produced head gestures that occurred in Swedish television news readings. Sixteen short clips (containing 218 words in total) were rated for word prominence by 85 adult volunteers in a between-subjects design (44 in an audio-visual vs. 41 in an audio-only condition) using a web-based rating task. As an initial test of overall rating behavior, average prominence across all 218 words was compared between the two conditions, revealing no significant difference. In a second step, we compared normalized prominence ratings... (More)
Visual information can be integrated in prominence perception, but most available evidence stems from controlled experimental settings, often involving synthetic stimuli. The present study provides evidence from spontaneously produced head gestures that occurred in Swedish television news readings. Sixteen short clips (containing 218 words in total) were rated for word prominence by 85 adult volunteers in a between-subjects design (44 in an audio-visual vs. 41 in an audio-only condition) using a web-based rating task. As an initial test of overall rating behavior, average prominence across all 218 words was compared between the two conditions, revealing no significant difference. In a second step, we compared normalized prominence ratings between the two conditions for all 218 words individually. These results displayed significant (or near significant, p (Less)
Please use this url to cite or link to this publication:
author
; and
organization
publishing date
type
Chapter in Book/Report/Conference proceeding
publication status
published
subject
keywords
prominence perception, multimodality, beat gesture, pitch accent, visual prosody
host publication
Proceedings of the 11th International Conference on Speech Prosody : Speech Prosody 2022 - Speech Prosody 2022
series title
Proceedings of the International Conference on Speech Prosody
editor
Frota, Sónia ; Cruz, Marisa and Vigário, Marina
pages
5 pages
publisher
ISCA
conference name
11th International Conference on Speech Prosody
conference location
Lisbon, Portugal
conference dates
2022-05-23 - 2022-05-26
external identifiers
  • scopus:85147200055
ISSN
2333-2042
DOI
10.21437/SpeechProsody.2022-72
project
Språkbanken & Swe-Clarin
language
English
LU publication?
yes
id
97c3b52a-175c-45cf-ac8f-6ebc81157c80
date added to LUP
2023-06-21 11:31:36
date last changed
2023-10-09 04:00:40
@inproceedings{97c3b52a-175c-45cf-ac8f-6ebc81157c80,
  abstract     = {{Visual information can be integrated in prominence perception, but most available evidence stems from controlled experimental settings, often involving synthetic stimuli. The present study provides evidence from spontaneously produced head gestures that occurred in Swedish television news readings. Sixteen short clips (containing 218 words in total) were rated for word prominence by 85 adult volunteers in a between-subjects design (44 in an audio-visual vs. 41 in an audio-only condition) using a web-based rating task. As an initial test of overall rating behavior, average prominence across all 218 words was compared between the two conditions, revealing no significant difference. In a second step, we compared normalized prominence ratings between the two conditions for all 218 words individually. These results displayed significant (or near significant, p}},
  author       = {{Ambrazaitis, Gilbert and Frid, Johan and House, David}},
  booktitle    = {{Proceedings of the 11th International Conference on Speech Prosody : Speech Prosody 2022}},
  editor       = {{Frota, Sónia and Cruz, Marisa and Vigário, Marina}},
  issn         = {{2333-2042}},
  keywords     = {{prominence perception; multimodality; beat gesture; pitch accent; visual prosody}},
  language     = {{eng}},
  pages        = {{352--356}},
  publisher    = {{ISCA}},
  series       = {{Proceedings of the International Conference on Speech Prosody}},
  title        = {{Auditory vs. audiovisual prominence ratings of speech involving spontaneously produced head movements}},
  url          = {{http://dx.doi.org/10.21437/SpeechProsody.2022-72}},
  doi          = {{10.21437/SpeechProsody.2022-72}},
  year         = {{2022}},
}