Skip to main content

Lund University Publications

LUND UNIVERSITY LIBRARIES

The Civic Argument Literacy Test (CALT) : Foundations and Development

Hietanen, Mika LU orcid and Svedholm-Häkkinen, Annika M. (2026) In Argumentation
Abstract
The Civic Argument Literacy Test (CALT) is a new instrument for measuring how individuals recognise, interpret, and evaluate arguments in civic discourse. This research essay sets out the conceptual and theoretical foundations of the CALT and, as its central contribution, the design principles underlying its ten diagnostic parts. After defining argument literacy as a civic competence and locating the construct within rhetorical theory, argumentation studies, and the new literacy studies tradition, we describe how each dimension is operationalised as a concrete task, and how this relates to existing operationalisations in psychological and pedagogical research studies. We further describe the deliberate move from fully authentic to... (More)
The Civic Argument Literacy Test (CALT) is a new instrument for measuring how individuals recognise, interpret, and evaluate arguments in civic discourse. This research essay sets out the conceptual and theoretical foundations of the CALT and, as its central contribution, the design principles underlying its ten diagnostic parts. After defining argument literacy as a civic competence and locating the construct within rhetorical theory, argumentation studies, and the new literacy studies tradition, we describe how each dimension is operationalised as a concrete task, and how this relates to existing operationalisations in psychological and pedagogical research studies. We further describe the deliberate move from fully authentic to semi-authentic civic materials, and the iterative shaping of the ten-part structure across two pilot studies and a validation study. A cross-linguistic survey of argumentation, rhetoric, and critical-thinking textbooks provides content-validity evidence: the components the CALT operationalises recur as chapter-level topics in independently authored works from distinct academic traditions. The CALT translates concepts from rhetorical and argumentation theory – enthymemes, argument schemes, rhetorical proofs, visual argument, fallacy recognition – into scalable tasks embedded in semi-authentic public discourse, intended for upper secondary and undergraduate populations. The validation study provides evidence (N = 178, UK adults aged 18–25) that the CALT has good reliability as a total-score measure, and we discuss its dimensionality and discriminant validity. By bridging argumentation theory with empirical assessment, the CALT contributes to experimental argumentation research, offering a diagnostic tool for studying how citizens process arguments across contexts and populations. (Less)
Please use this url to cite or link to this publication:
author
and
organization
publishing date
type
Contribution to journal
publication status
epub
subject
keywords
Experimental argumentation, Assessment, Argument literacy, Content validity, Psychometrics, Critical thinking
in
Argumentation
pages
27 pages
publisher
Springer
ISSN
1572-8374
DOI
10.1007/s10503-026-09717-z
language
English
LU publication?
yes
id
fe82c29b-90cc-4ffe-8a98-1d306eedd07d
date added to LUP
2026-08-24 13:26:40
date last changed
2026-09-15 22:31:46
@article{fe82c29b-90cc-4ffe-8a98-1d306eedd07d,
  abstract     = {{The Civic Argument Literacy Test (CALT) is a new instrument for measuring how individuals recognise, interpret, and evaluate arguments in civic discourse. This research essay sets out the conceptual and theoretical foundations of the CALT and, as its central contribution, the design principles underlying its ten diagnostic parts. After defining argument literacy as a civic competence and locating the construct within rhetorical theory, argumentation studies, and the new literacy studies tradition, we describe how each dimension is operationalised as a concrete task, and how this relates to existing operationalisations in psychological and pedagogical research studies. We further describe the deliberate move from fully authentic to semi-authentic civic materials, and the iterative shaping of the ten-part structure across two pilot studies and a validation study. A cross-linguistic survey of argumentation, rhetoric, and critical-thinking textbooks provides content-validity evidence: the components the CALT operationalises recur as chapter-level topics in independently authored works from distinct academic traditions. The CALT translates concepts from rhetorical and argumentation theory – enthymemes, argument schemes, rhetorical proofs, visual argument, fallacy recognition – into scalable tasks embedded in semi-authentic public discourse, intended for upper secondary and undergraduate populations. The validation study provides evidence (N = 178, UK adults aged 18–25) that the CALT has good reliability as a total-score measure, and we discuss its dimensionality and discriminant validity. By bridging argumentation theory with empirical assessment, the CALT contributes to experimental argumentation research, offering a diagnostic tool for studying how citizens process arguments across contexts and populations.}},
  author       = {{Hietanen, Mika and Svedholm-Häkkinen, Annika M.}},
  issn         = {{1572-8374}},
  keywords     = {{Experimental argumentation; Assessment; Argument literacy; Content validity; Psychometrics; Critical thinking}},
  language     = {{eng}},
  month        = {{08}},
  publisher    = {{Springer}},
  series       = {{Argumentation}},
  title        = {{The Civic Argument Literacy Test (CALT) : Foundations and Development}},
  url          = {{http://dx.doi.org/10.1007/s10503-026-09717-z}},
  doi          = {{10.1007/s10503-026-09717-z}},
  year         = {{2026}},
}