Analyzing polysemiosis : Language, gesture, and depiction in two cultural practices with sand drawing
(2023) In Semiotica 2023(253). p.81-116- Abstract
Human communication is by default polysemiotic: it involves the spontaneous combination of two or more semiotic systems, the most important ones being language, gesture, and depiction. We formulate an original cognitive-semiotic framework for the analysis of polysemiosis, contrasting this with more familiar systems based on the ambiguous term "multimodality."To be fully explicit, we developed a coding system for the analysis of polysemiotic utterances containing speech, gesture, and drawing, and implemented this in the ELAN video annotation software. We used this to analyze 23 video-recordings of sand drawing performances on Paama, Vanuatu and 20 sand stories of the Pitjantjatjara culture in Central Australia. Methodologically we used... (More)
Human communication is by default polysemiotic: it involves the spontaneous combination of two or more semiotic systems, the most important ones being language, gesture, and depiction. We formulate an original cognitive-semiotic framework for the analysis of polysemiosis, contrasting this with more familiar systems based on the ambiguous term "multimodality."To be fully explicit, we developed a coding system for the analysis of polysemiotic utterances containing speech, gesture, and drawing, and implemented this in the ELAN video annotation software. We used this to analyze 23 video-recordings of sand drawing performances on Paama, Vanuatu and 20 sand stories of the Pitjantjatjara culture in Central Australia. Methodologically we used the conceptual-empirical loop of cognitive semiotics: our theoretical framework guided general considerations, such as distinguishing between the "tiers"of gesture and depiction, and the three kinds of semiotic grounds (iconic, indexical, symbolic), but the precise decisions on how to operationalize these were made only after extensive work with the material. We describe the coding system in detail and provide illustrative examples from the Paamese and Pitjantjatjara data, remarking on both similarities and differences in the polysemiosis of the two cultural practices. We conclude by summarizing the contributions of the study and point to some directions for future research.
(Less)
- author
- Zlatev, Jordan LU ; Devylder, Simon LU ; Defina, Rebecca ; Moskaluk, Kalina LU and Andersen, Linea Brink LU
- organization
- publishing date
- 2023
- type
- Contribution to journal
- publication status
- published
- subject
- keywords
- cognitive semiotics, diagrams, Paama, Pitjantjatjara, sand stories, semiotic grounds, sign systems
- in
- Semiotica
- volume
- 2023
- issue
- 253
- pages
- 81 - 116
- publisher
- De Gruyter
- external identifiers
-
- scopus:85163946525
- ISSN
- 0037-1998
- DOI
- 10.1515/sem-2022-0102
- language
- English
- LU publication?
- yes
- id
- 2d125e52-85ff-41e0-b2fb-e0bdbbde3e5c
- date added to LUP
- 2023-10-06 14:54:16
- date last changed
- 2024-01-09 15:45:53
@article{2d125e52-85ff-41e0-b2fb-e0bdbbde3e5c,
abstract = {{<p>Human communication is by default polysemiotic: it involves the spontaneous combination of two or more semiotic systems, the most important ones being language, gesture, and depiction. We formulate an original cognitive-semiotic framework for the analysis of polysemiosis, contrasting this with more familiar systems based on the ambiguous term "multimodality."To be fully explicit, we developed a coding system for the analysis of polysemiotic utterances containing speech, gesture, and drawing, and implemented this in the ELAN video annotation software. We used this to analyze 23 video-recordings of sand drawing performances on Paama, Vanuatu and 20 sand stories of the Pitjantjatjara culture in Central Australia. Methodologically we used the conceptual-empirical loop of cognitive semiotics: our theoretical framework guided general considerations, such as distinguishing between the "tiers"of gesture and depiction, and the three kinds of semiotic grounds (iconic, indexical, symbolic), but the precise decisions on how to operationalize these were made only after extensive work with the material. We describe the coding system in detail and provide illustrative examples from the Paamese and Pitjantjatjara data, remarking on both similarities and differences in the polysemiosis of the two cultural practices. We conclude by summarizing the contributions of the study and point to some directions for future research.</p>}},
author = {{Zlatev, Jordan and Devylder, Simon and Defina, Rebecca and Moskaluk, Kalina and Andersen, Linea Brink}},
issn = {{0037-1998}},
keywords = {{cognitive semiotics; diagrams; Paama; Pitjantjatjara; sand stories; semiotic grounds; sign systems}},
language = {{eng}},
number = {{253}},
pages = {{81--116}},
publisher = {{De Gruyter}},
series = {{Semiotica}},
title = {{Analyzing polysemiosis : Language, gesture, and depiction in two cultural practices with sand drawing}},
url = {{http://dx.doi.org/10.1515/sem-2022-0102}},
doi = {{10.1515/sem-2022-0102}},
volume = {{2023}},
year = {{2023}},
}