Skip to main content

Lund University Publications

LUND UNIVERSITY LIBRARIES

Task-related gaze behaviour in face-to-face dyadic collaboration : Toward an interactive theory?

Hessels, Roy S. ; Teunisse, Martin K. ; Niehorster, Diederick C. LU orcid ; Nyström, Marcus LU orcid ; Benjamins, Jeroen S. ; Senju, Atsushi and Hooge, Ignace T.C. LU (2023) In Visual Cognition 31(4). p.291-313
Abstract

Visual routines theory posits that vision is critical for guiding sequential actions in the world. Most studies on the link between vision and sequential action have considered individual agents, while substantial human behaviour is characterized by multi-party interaction. Here, the actions of each person may affect what the other can subsequently do. We investigated task execution and gaze allocation of 19 dyads completing a Duplo-model copying task together, while wearing the Pupil Invisible eye tracker. We varied whether all blocks were visible to both participants, and whether verbal communication was allowed. For models in which not all blocks were visible, participants seemed to coordinate their gaze: The distance between the... (More)

Visual routines theory posits that vision is critical for guiding sequential actions in the world. Most studies on the link between vision and sequential action have considered individual agents, while substantial human behaviour is characterized by multi-party interaction. Here, the actions of each person may affect what the other can subsequently do. We investigated task execution and gaze allocation of 19 dyads completing a Duplo-model copying task together, while wearing the Pupil Invisible eye tracker. We varied whether all blocks were visible to both participants, and whether verbal communication was allowed. For models in which not all blocks were visible, participants seemed to coordinate their gaze: The distance between the participants' gaze positions was smaller and dyads looked longer at the model concurrently than for models in which all blocks were visible. This was most pronounced when verbal communication was allowed. We conclude that the way the collaborative task was executed depended both on whether visual information was available to both persons, and how communication took place. Modelling task structure and gaze allocation for human-human and human-robot collaboration thus requires more than the observable behaviour of either individual. We discuss whether an interactive visual routines theory ought to be pursued.

(Less)
Please use this url to cite or link to this publication:
author
; ; ; ; ; and
organization
publishing date
type
Contribution to journal
publication status
published
subject
keywords
collaboration, eye tracking, Gaze allocation, task control, visual routines
in
Visual Cognition
volume
31
issue
4
pages
291 - 313
publisher
Taylor & Francis
external identifiers
  • scopus:85169328793
ISSN
1350-6285
DOI
10.1080/13506285.2023.2250507
language
English
LU publication?
yes
additional info
Publisher Copyright: © 2023 The Author(s). Published by Informa UK Limited, trading as Taylor & Francis Group.
id
2fea4b6e-98d8-4fbd-805f-c3ea77f5c641
date added to LUP
2023-09-07 14:32:46
date last changed
2024-01-09 15:46:33
@article{2fea4b6e-98d8-4fbd-805f-c3ea77f5c641,
  abstract     = {{<p>Visual routines theory posits that vision is critical for guiding sequential actions in the world. Most studies on the link between vision and sequential action have considered individual agents, while substantial human behaviour is characterized by multi-party interaction. Here, the actions of each person may affect what the other can subsequently do. We investigated task execution and gaze allocation of 19 dyads completing a Duplo-model copying task together, while wearing the Pupil Invisible eye tracker. We varied whether all blocks were visible to both participants, and whether verbal communication was allowed. For models in which not all blocks were visible, participants seemed to coordinate their gaze: The distance between the participants' gaze positions was smaller and dyads looked longer at the model concurrently than for models in which all blocks were visible. This was most pronounced when verbal communication was allowed. We conclude that the way the collaborative task was executed depended both on whether visual information was available to both persons, and how communication took place. Modelling task structure and gaze allocation for human-human and human-robot collaboration thus requires more than the observable behaviour of either individual. We discuss whether an interactive visual routines theory ought to be pursued.</p>}},
  author       = {{Hessels, Roy S. and Teunisse, Martin K. and Niehorster, Diederick C. and Nyström, Marcus and Benjamins, Jeroen S. and Senju, Atsushi and Hooge, Ignace T.C.}},
  issn         = {{1350-6285}},
  keywords     = {{collaboration; eye tracking; Gaze allocation; task control; visual routines}},
  language     = {{eng}},
  month        = {{08}},
  number       = {{4}},
  pages        = {{291--313}},
  publisher    = {{Taylor & Francis}},
  series       = {{Visual Cognition}},
  title        = {{Task-related gaze behaviour in face-to-face dyadic collaboration : Toward an interactive theory?}},
  url          = {{http://dx.doi.org/10.1080/13506285.2023.2250507}},
  doi          = {{10.1080/13506285.2023.2250507}},
  volume       = {{31}},
  year         = {{2023}},
}