Advanced

Attention to speech-accompanying gestures: Eye movements and information uptake

Gullberg, Marianne LU and Kita, Sotaro (2009) In Journal of Nonverbal Behavior 33(4). p.251-277
Abstract
There is growing evidence that addressees in interaction integrate the semantic information conveyed by speakers’ gestures. Little is known, however, about whether and how addressees’ attention to gestures and the integration of gestural information can be modulated. This study examines the influence of a social factor (speakers’ gaze to their own gestures), and two physical factors (the gesture’s location in gesture space and gestural holds) on addressees’ overt visual attention to gestures (direct fixations of gestures) and their uptake of gestural information. It also examines the relationship between gaze and uptake. The results indicate that addressees’ overt visual attention to gestures is affected both by speakers’ gaze and holds... (More)
There is growing evidence that addressees in interaction integrate the semantic information conveyed by speakers’ gestures. Little is known, however, about whether and how addressees’ attention to gestures and the integration of gestural information can be modulated. This study examines the influence of a social factor (speakers’ gaze to their own gestures), and two physical factors (the gesture’s location in gesture space and gestural holds) on addressees’ overt visual attention to gestures (direct fixations of gestures) and their uptake of gestural information. It also examines the relationship between gaze and uptake. The results indicate that addressees’ overt visual attention to gestures is affected both by speakers’ gaze and holds but for different reasons, whereas location in space plays no role. Addressees’ uptake of gesture information is only influenced by speakers’ gaze. There is little evidence of a direct relationship between addressees’ direct fixations of gestures and their uptake. (Less)
Please use this url to cite or link to this publication:
author
publishing date
type
Contribution to journal
publication status
published
subject
keywords
interaction, eye gaze, fixation, gesture, multimodal information processing
in
Journal of Nonverbal Behavior
volume
33
issue
4
pages
251 - 277
publisher
Springer
external identifiers
  • Scopus:76149095912
ISSN
1573-3653
DOI
10.1007/s10919-009-0073-2
language
English
LU publication?
no
id
d9339d87-c49a-447e-a76a-7e4c8494d62e (old id 1579015)
date added to LUP
2010-03-22 17:28:10
date last changed
2016-10-13 04:54:12
@misc{d9339d87-c49a-447e-a76a-7e4c8494d62e,
  abstract     = {There is growing evidence that addressees in interaction integrate the semantic information conveyed by speakers’ gestures. Little is known, however, about whether and how addressees’ attention to gestures and the integration of gestural information can be modulated. This study examines the influence of a social factor (speakers’ gaze to their own gestures), and two physical factors (the gesture’s location in gesture space and gestural holds) on addressees’ overt visual attention to gestures (direct fixations of gestures) and their uptake of gestural information. It also examines the relationship between gaze and uptake. The results indicate that addressees’ overt visual attention to gestures is affected both by speakers’ gaze and holds but for different reasons, whereas location in space plays no role. Addressees’ uptake of gesture information is only influenced by speakers’ gaze. There is little evidence of a direct relationship between addressees’ direct fixations of gestures and their uptake.},
  author       = {Gullberg, Marianne and Kita, Sotaro},
  issn         = {1573-3653},
  keyword      = {interaction,eye gaze,fixation,gesture,multimodal information processing},
  language     = {eng},
  number       = {4},
  pages        = {251--277},
  publisher    = {ARRAY(0xaae9500)},
  series       = {Journal of Nonverbal Behavior},
  title        = {Attention to speech-accompanying gestures: Eye movements and information uptake},
  url          = {http://dx.doi.org/10.1007/s10919-009-0073-2},
  volume       = {33},
  year         = {2009},
}