Skip to main content

Lund University Publications

LUND UNIVERSITY LIBRARIES

Stable eye versus mouth preference in a live speech-processing task

Viktorsson, Charlotte ; Valtakari, Niilo V ; Falck-Ytter, Terje ; Hooge, Ignace T C LU ; Rudling, Maja LU orcid and Hessels, Roy S (2023) In Scientific Reports 13(1).
Abstract

Looking at the mouth region is thought to be a useful strategy for speech-perception tasks. The tendency to look at the eyes versus the mouth of another person during speech processing has thus far mainly been studied using screen-based paradigms. In this study, we estimated the eye-mouth-index (EMI) of 38 adult participants in a live setting. Participants were seated across the table from an experimenter, who read sentences out loud for the participant to remember in both a familiar (English) and unfamiliar (Finnish) language. No statistically significant difference in the EMI between the familiar and the unfamiliar languages was observed. Total relative looking time at the mouth also did not predict the number of correctly identified... (More)

Looking at the mouth region is thought to be a useful strategy for speech-perception tasks. The tendency to look at the eyes versus the mouth of another person during speech processing has thus far mainly been studied using screen-based paradigms. In this study, we estimated the eye-mouth-index (EMI) of 38 adult participants in a live setting. Participants were seated across the table from an experimenter, who read sentences out loud for the participant to remember in both a familiar (English) and unfamiliar (Finnish) language. No statistically significant difference in the EMI between the familiar and the unfamiliar languages was observed. Total relative looking time at the mouth also did not predict the number of correctly identified sentences. Instead, we found that the EMI was higher during an instruction phase than during the speech-processing task. Moreover, we observed high intra-individual correlations in the EMI across the languages and different phases of the experiment. We conclude that there are stable individual differences in looking at the eyes versus the mouth of another person. Furthermore, this behavior appears to be flexible and dependent on the requirements of the situation (speech processing or not).

(Less)
Please use this url to cite or link to this publication:
author
; ; ; ; and
publishing date
type
Contribution to journal
publication status
published
subject
keywords
Adult, Humans, Speech, Eye, Speech Perception, Language, Face, Face processing, Live eye tracking, Social interaction, Speech processing
in
Scientific Reports
volume
13
issue
1
article number
12878
publisher
Nature Publishing Group
external identifiers
  • scopus:85167370552
  • pmid:37553414
ISSN
2045-2322
DOI
10.1038/s41598-023-40017-8
language
English
LU publication?
no
additional info
© 2023. Springer Nature Limited.
id
47b56341-f22d-4bd2-add4-d48c8ecd64db
date added to LUP
2023-08-24 12:53:31
date last changed
2024-04-20 02:37:12
@article{47b56341-f22d-4bd2-add4-d48c8ecd64db,
  abstract     = {{<p>Looking at the mouth region is thought to be a useful strategy for speech-perception tasks. The tendency to look at the eyes versus the mouth of another person during speech processing has thus far mainly been studied using screen-based paradigms. In this study, we estimated the eye-mouth-index (EMI) of 38 adult participants in a live setting. Participants were seated across the table from an experimenter, who read sentences out loud for the participant to remember in both a familiar (English) and unfamiliar (Finnish) language. No statistically significant difference in the EMI between the familiar and the unfamiliar languages was observed. Total relative looking time at the mouth also did not predict the number of correctly identified sentences. Instead, we found that the EMI was higher during an instruction phase than during the speech-processing task. Moreover, we observed high intra-individual correlations in the EMI across the languages and different phases of the experiment. We conclude that there are stable individual differences in looking at the eyes versus the mouth of another person. Furthermore, this behavior appears to be flexible and dependent on the requirements of the situation (speech processing or not).</p>}},
  author       = {{Viktorsson, Charlotte and Valtakari, Niilo V and Falck-Ytter, Terje and Hooge, Ignace T C and Rudling, Maja and Hessels, Roy S}},
  issn         = {{2045-2322}},
  keywords     = {{Adult; Humans; Speech; Eye; Speech Perception; Language; Face; Face processing; Live eye tracking; Social interaction; Speech processing}},
  language     = {{eng}},
  month        = {{08}},
  number       = {{1}},
  publisher    = {{Nature Publishing Group}},
  series       = {{Scientific Reports}},
  title        = {{Stable eye versus mouth preference in a live speech-processing task}},
  url          = {{http://dx.doi.org/10.1038/s41598-023-40017-8}},
  doi          = {{10.1038/s41598-023-40017-8}},
  volume       = {{13}},
  year         = {{2023}},
}