Skip to main content

Lund University Publications

LUND UNIVERSITY LIBRARIES

Studying multimodal language processing : The integration of speech and gestures

Gullberg, Marianne LU orcid (2022) In The Routledge Handbooks in Second Language Acquisition p.137-149
Abstract
All language use is a multimodal endeavor. Language processing must deal with both auditory and visual signals and integrate them with millisecond precision. This chapter presents evidence for the inherently multimodal nature of language use, outlines the implications for the study of L2 processing, and provides a survey of the main methods used to probe multimodal processing in production and comprehension. The chapter describes some key issues in the study of L2 production and comprehension, and outlines pros and cons with the methods chosen. It closes with a discussion of open questions, challenges, and future research topics.
Please use this url to cite or link to this publication:
author
organization
publishing date
type
Chapter in Book/Report/Conference proceeding
publication status
published
subject
keywords
gesture, SLA, L2, Language processing, crossmodal coordination, Crossmodal information processing
host publication
The Routledge handbook of second language acquisition and psycholinguistics
series title
The Routledge Handbooks in Second Language Acquisition
editor
Godfroid, Aline and Hopp, Holger
edition
1
pages
13 pages
publisher
Routledge
ISBN
9781003018872
9780367893767
DOI
10.4324/9781003018872-14
project
Embodied bilingualism (a Wallenberg Scholar project)
language
English
LU publication?
yes
id
2750dd74-b796-48f3-bb3f-efd7ccb9009a
date added to LUP
2020-09-24 08:32:35
date last changed
2023-05-10 14:10:26
@inbook{2750dd74-b796-48f3-bb3f-efd7ccb9009a,
  abstract     = {{All language use is a multimodal endeavor. Language processing must deal with both auditory and visual signals and integrate them with millisecond precision. This chapter presents evidence for the inherently multimodal nature of language use, outlines the implications for the study of L2 processing, and provides a survey of the main methods used to probe multimodal processing in production and comprehension. The chapter describes some key issues in the study of L2 production and comprehension, and outlines pros and cons with the methods chosen. It closes with a discussion of open questions, challenges, and future research topics.}},
  author       = {{Gullberg, Marianne}},
  booktitle    = {{The Routledge handbook of second language acquisition and psycholinguistics}},
  editor       = {{Godfroid, Aline and Hopp, Holger}},
  isbn         = {{9781003018872}},
  keywords     = {{gesture; SLA; L2; Language processing; crossmodal coordination; Crossmodal information processing}},
  language     = {{eng}},
  pages        = {{137--149}},
  publisher    = {{Routledge}},
  series       = {{The Routledge Handbooks in Second Language Acquisition}},
  title        = {{Studying multimodal language processing : The integration of speech and gestures}},
  url          = {{http://dx.doi.org/10.4324/9781003018872-14}},
  doi          = {{10.4324/9781003018872-14}},
  year         = {{2022}},
}