Skip to main content

Lund University Publications

LUND UNIVERSITY LIBRARIES

Semantic processing of verbal narratives compared to semantic processing of visual narratives : an ERP study of school-aged children

Lindfors, Hanna ; Hansson, Kristina LU orcid ; Pakulak, Eric ; Cohn, Neil and Andersson, Annika LU (2023) In Frontiers in Psychology 14.
Abstract

There is a misconception that pictures are easy to comprehend, which is problematic in pedagogical practices that include pictures. For example, if a child has difficulties with verbal narration to picture sequences, it may be interpreted as specific to spoken language even though the child may have additional difficulties with comprehension of visual narratives in the form of picture sequences. The purpose of the present study was therefore to increase our understanding of semantic processing in the pictorial domain in relation to semantic processing in the verbal domain, focusing on 9–13 years-old children with typical language development. To this end, we measured electrical brain responses (event related potentials, ERPs) in 17... (More)

There is a misconception that pictures are easy to comprehend, which is problematic in pedagogical practices that include pictures. For example, if a child has difficulties with verbal narration to picture sequences, it may be interpreted as specific to spoken language even though the child may have additional difficulties with comprehension of visual narratives in the form of picture sequences. The purpose of the present study was therefore to increase our understanding of semantic processing in the pictorial domain in relation to semantic processing in the verbal domain, focusing on 9–13 years-old children with typical language development. To this end, we measured electrical brain responses (event related potentials, ERPs) in 17 children to (i) pictures (panels) that were predicted versus unpredicted in sequences of panels that conveyed visual narratives and (ii) words that were predicted versus unpredicted in sentences that conveyed verbal narratives. Results demonstrated similarities as there were no significant difference in the magnitude of the N400 effect across domains. The only difference between domains was the predicted difference in distribution, that is, a more posterior N400 effect in the verbal domain than in the pictorial domain. The study contributes to an increased understanding of the complexity of processing of visual narratives and its shared features with processing of verbal narratives, which should be considered in pedagogical practices.

(Less)
Please use this url to cite or link to this publication:
author
; ; ; and
organization
publishing date
type
Contribution to journal
publication status
published
subject
keywords
children, comics, event related potentials, N400, narratives, pictures, semantic processing
in
Frontiers in Psychology
volume
14
article number
1253509
publisher
Frontiers Media S. A.
external identifiers
  • pmid:38282837
  • scopus:85183642469
ISSN
1664-1078
DOI
10.3389/fpsyg.2023.1253509
language
English
LU publication?
yes
id
7706a85e-6bee-4538-8400-d7d911848800
date added to LUP
2024-02-15 14:45:03
date last changed
2024-04-16 13:48:14
@article{7706a85e-6bee-4538-8400-d7d911848800,
  abstract     = {{<p>There is a misconception that pictures are easy to comprehend, which is problematic in pedagogical practices that include pictures. For example, if a child has difficulties with verbal narration to picture sequences, it may be interpreted as specific to spoken language even though the child may have additional difficulties with comprehension of visual narratives in the form of picture sequences. The purpose of the present study was therefore to increase our understanding of semantic processing in the pictorial domain in relation to semantic processing in the verbal domain, focusing on 9–13 years-old children with typical language development. To this end, we measured electrical brain responses (event related potentials, ERPs) in 17 children to (i) pictures (panels) that were predicted versus unpredicted in sequences of panels that conveyed visual narratives and (ii) words that were predicted versus unpredicted in sentences that conveyed verbal narratives. Results demonstrated similarities as there were no significant difference in the magnitude of the N400 effect across domains. The only difference between domains was the predicted difference in distribution, that is, a more posterior N400 effect in the verbal domain than in the pictorial domain. The study contributes to an increased understanding of the complexity of processing of visual narratives and its shared features with processing of verbal narratives, which should be considered in pedagogical practices.</p>}},
  author       = {{Lindfors, Hanna and Hansson, Kristina and Pakulak, Eric and Cohn, Neil and Andersson, Annika}},
  issn         = {{1664-1078}},
  keywords     = {{children; comics; event related potentials; N400; narratives; pictures; semantic processing}},
  language     = {{eng}},
  publisher    = {{Frontiers Media S. A.}},
  series       = {{Frontiers in Psychology}},
  title        = {{Semantic processing of verbal narratives compared to semantic processing of visual narratives : an ERP study of school-aged children}},
  url          = {{http://dx.doi.org/10.3389/fpsyg.2023.1253509}},
  doi          = {{10.3389/fpsyg.2023.1253509}},
  volume       = {{14}},
  year         = {{2023}},
}