Skip to main content

Lund University Publications

LUND UNIVERSITY LIBRARIES

Some common statistical methods for assessing rater agreement in radiological studies

Geijer, Mats LU ; Båth, Magnus and Wessman, Catrin (2025) In Acta Radiologica 66(6). p.675-683
Abstract

Rater agreement is commonly assessed in radiologic studies concerning image quality. There are several methods of measuring rater agreement. To choose the appropriate method, the researcher needs to consider the scale of the outcome variable and the design of the study. This article provides a brief overview of available methods, focusing on the most practical and commonly used, including intraclass correlation, the Svensson method, variants of the kappa statistic, the agreement coefficient by Gwet (AC1/AC2), and Krippendorff's alpha. Additional methods that are not primarily intended for rater agreement analysis but are applied in some cases are also discussed.

Please use this url to cite or link to this publication:
author
; and
organization
publishing date
type
Contribution to journal
publication status
published
subject
keywords
image quality assessment, observer agreement, observer variation, radiological studies, Statistical methods
in
Acta Radiologica
volume
66
issue
6
pages
9 pages
publisher
SAGE Publications
external identifiers
  • pmid:39988909
  • scopus:86000766741
ISSN
0284-1851
DOI
10.1177/02841851251319666
language
English
LU publication?
yes
id
f9b61834-cc48-47a0-89f3-8cb25e5a280d
date added to LUP
2025-06-25 09:57:55
date last changed
2025-07-09 12:09:47
@article{f9b61834-cc48-47a0-89f3-8cb25e5a280d,
  abstract     = {{<p>Rater agreement is commonly assessed in radiologic studies concerning image quality. There are several methods of measuring rater agreement. To choose the appropriate method, the researcher needs to consider the scale of the outcome variable and the design of the study. This article provides a brief overview of available methods, focusing on the most practical and commonly used, including intraclass correlation, the Svensson method, variants of the kappa statistic, the agreement coefficient by Gwet (AC1/AC2), and Krippendorff's alpha. Additional methods that are not primarily intended for rater agreement analysis but are applied in some cases are also discussed.</p>}},
  author       = {{Geijer, Mats and Båth, Magnus and Wessman, Catrin}},
  issn         = {{0284-1851}},
  keywords     = {{image quality assessment; observer agreement; observer variation; radiological studies; Statistical methods}},
  language     = {{eng}},
  number       = {{6}},
  pages        = {{675--683}},
  publisher    = {{SAGE Publications}},
  series       = {{Acta Radiologica}},
  title        = {{Some common statistical methods for assessing rater agreement in radiological studies}},
  url          = {{http://dx.doi.org/10.1177/02841851251319666}},
  doi          = {{10.1177/02841851251319666}},
  volume       = {{66}},
  year         = {{2025}},
}