Motion iconicity in prosody
(2022) In Frontiers in Communication 7.- Abstract
- Evidence suggests that human non-verbal speech may be rich in iconicity. Here, we report results from two experiments aimed at testing whether perception of increasing and declining f0 can be iconically mapped onto motion events. We presented a sample of mixed-nationality participants (N = 118) with sets of two videos, where one pictured upward movement and the other downward movement. A disyllabic non-sense word prosodically resynthesized as increasing or declining in f0 was presented simultaneously with each video in a pair, and participants were tasked with guessing which of the two videos the word described. Results indicate that prosody is iconically associated with motion, such that motion-prosody congruent pairings were more readily... (More)
- Evidence suggests that human non-verbal speech may be rich in iconicity. Here, we report results from two experiments aimed at testing whether perception of increasing and declining f0 can be iconically mapped onto motion events. We presented a sample of mixed-nationality participants (N = 118) with sets of two videos, where one pictured upward movement and the other downward movement. A disyllabic non-sense word prosodically resynthesized as increasing or declining in f0 was presented simultaneously with each video in a pair, and participants were tasked with guessing which of the two videos the word described. Results indicate that prosody is iconically associated with motion, such that motion-prosody congruent pairings were more readily selected than incongruent pairings (p < 0.033). However, the effect observed in our sample was primarily driven by selections of words with declining f0. A follow-up experiment with native Turkish speaking participants (N = 92) tested for the effect of language-specific metaphor for auditory pitch. Results showed no significant association between prosody and motion. Limitations of the experiment, and some implications for the motor theory of speech perception, and “gestural origins” theories of language evolution, are discussed. (Less)
Please use this url to cite or link to this publication:
https://lup.lub.lu.se/record/4fdc434c-1fb7-42e6-a009-78345b48f336
- author
- Ekström, Axel G ; Nirme, Jens LU and Gärdenfors, Peter LU
- organization
- publishing date
- 2022
- type
- Contribution to journal
- publication status
- published
- subject
- keywords
- voice perception, gesture, paralinguistics, motor theory of speech perception, evolution of language
- in
- Frontiers in Communication
- volume
- 7
- article number
- 994162
- pages
- 9 pages
- publisher
- Frontiers Media S. A.
- external identifiers
-
- scopus:85139657836
- ISSN
- 2297-900X
- DOI
- 10.3389/fcomm.2022.994162
- language
- English
- LU publication?
- yes
- id
- 4fdc434c-1fb7-42e6-a009-78345b48f336
- date added to LUP
- 2022-09-30 13:09:25
- date last changed
- 2024-04-16 15:36:19
@article{4fdc434c-1fb7-42e6-a009-78345b48f336,
abstract = {{Evidence suggests that human non-verbal speech may be rich in iconicity. Here, we report results from two experiments aimed at testing whether perception of increasing and declining f0 can be iconically mapped onto motion events. We presented a sample of mixed-nationality participants (N = 118) with sets of two videos, where one pictured upward movement and the other downward movement. A disyllabic non-sense word prosodically resynthesized as increasing or declining in f0 was presented simultaneously with each video in a pair, and participants were tasked with guessing which of the two videos the word described. Results indicate that prosody is iconically associated with motion, such that motion-prosody congruent pairings were more readily selected than incongruent pairings (p < 0.033). However, the effect observed in our sample was primarily driven by selections of words with declining f0. A follow-up experiment with native Turkish speaking participants (N = 92) tested for the effect of language-specific metaphor for auditory pitch. Results showed no significant association between prosody and motion. Limitations of the experiment, and some implications for the motor theory of speech perception, and “gestural origins” theories of language evolution, are discussed.}},
author = {{Ekström, Axel G and Nirme, Jens and Gärdenfors, Peter}},
issn = {{2297-900X}},
keywords = {{voice perception; gesture; paralinguistics; motor theory of speech perception; evolution of language}},
language = {{eng}},
publisher = {{Frontiers Media S. A.}},
series = {{Frontiers in Communication}},
title = {{Motion iconicity in prosody}},
url = {{http://dx.doi.org/10.3389/fcomm.2022.994162}},
doi = {{10.3389/fcomm.2022.994162}},
volume = {{7}},
year = {{2022}},
}