Advanced

Methodologies for Multimodal Research

(2012) In Visual Communication 11(3, Special Issue).
Abstract
This special issue presents and discusses prominent methods
and tools for multimodal analysis and reception. It comprises an editorial, a set of six papers and a book review and brings together international researchers from Germany, Sweden, Denmark, United States and Singapore representing various disciplines: communication and media studies, social semiotics, cognitive science, educational psychology, health studies and visual communication.

The methods include content analysis, social semiotic analysis, eye tracking
measurements – in combination with think aloud protocols and retrospective
interviews – as well as iconology and psychophysiological real time measurements.

The respective approaches are... (More)
This special issue presents and discusses prominent methods
and tools for multimodal analysis and reception. It comprises an editorial, a set of six papers and a book review and brings together international researchers from Germany, Sweden, Denmark, United States and Singapore representing various disciplines: communication and media studies, social semiotics, cognitive science, educational psychology, health studies and visual communication.

The methods include content analysis, social semiotic analysis, eye tracking
measurements – in combination with think aloud protocols and retrospective
interviews – as well as iconology and psychophysiological real time measurements.

The respective approaches are exemplified through detailed analyses
of a variety of materials, including press photography, art, multimodal health
education materials, PowerPoint presentations, internet advertisements and
TV media discussions.

The aim of the issue is to exchange current and novel methodological approaches in order to analyze visuality and multimodality by using a multidisciplinary framework. The articles cover and integrate a wide range of theoretical and methodological approaches to visual communication and multimodality and use a triangulation of methods to study the following issues: dynamic aspects of image perception; the role of individual differences and expertise; the role of the goal/task and context for perception and interpretation of visuals, attentional and cognitive processing underlying interaction with visuals; the role of knowledge; the emotional impact of visuals; and the process of meaning-making (intersemiosis) and the relation between visual attention, meaning attribution and emotion. (Less)
Please use this url to cite or link to this publication:
organization
publishing date
type
Contribution to journal
publication status
published
subject
keywords
interdisciplinary methodology, multimodality, visual communication
in
Visual Communication
editor
Holsanova, Jana LU and
volume
11
issue
3, Special Issue
pages
150 pages
publisher
SAGE Publications Inc.
ISSN
1470-3572
project
Cognition, Communication and Learning
language
English
LU publication?
yes
id
e6fcca81-5dce-441d-87db-6062090ec983 (old id 2303724)
date added to LUP
2012-01-30 11:40:22
date last changed
2018-05-29 11:34:44
@misc{e6fcca81-5dce-441d-87db-6062090ec983,
  abstract     = {This special issue presents and discusses prominent methods<br/>and tools for multimodal analysis and reception. It comprises an editorial, a set of six papers and a book review and brings together international researchers from Germany, Sweden, Denmark, United States and Singapore representing various disciplines: communication and media studies, social semiotics, cognitive science, educational psychology, health studies and visual communication.<br/><br/>The methods include content analysis, social semiotic analysis, eye tracking<br/>measurements – in combination with think aloud protocols and retrospective<br/>interviews – as well as iconology and psychophysiological real time measurements.<br/><br/>The respective approaches are exemplified through detailed analyses<br/>of a variety of materials, including press photography, art, multimodal health<br/>education materials, PowerPoint presentations, internet advertisements and<br/>TV media discussions.<br/><br/>The aim of the issue is to exchange current and novel methodological approaches in order to analyze visuality and multimodality by using a multidisciplinary framework. The articles cover and integrate a wide range of theoretical and methodological approaches to visual communication and multimodality and use a triangulation of methods to study the following issues: dynamic aspects of image perception; the role of individual differences and expertise; the role of the goal/task and context for perception and interpretation of visuals, attentional and cognitive processing underlying interaction with visuals; the role of knowledge; the emotional impact of visuals; and the process of meaning-making (intersemiosis) and the relation between visual attention, meaning attribution and emotion.},
  editor       = {Holsanova, Jana},
  issn         = {1470-3572},
  keyword      = {interdisciplinary methodology,multimodality,visual communication},
  language     = {eng},
  number       = {3, Special Issue},
  pages        = {150},
  publisher    = {SAGE Publications Inc.},
  series       = {Visual Communication},
  title        = {Methodologies for Multimodal Research},
  volume       = {11},
  year         = {2012},
}