Intra- and inter-observer reproducibility of assessment of Doppler ultrasound findings in adnexal masses.
Zannoni, L ; Savelli, L ; Jokubkiene, Ligita LU ; Di Legge, A ; Condous, G ; Testa, A C ; Sladkevicius, Povilas LU
and Valentin, Lil
LU
(2013)
In Ultrasound in Obstetrics & Gynecology
42(1).
p.93-101
- Abstract
- Objectives: To estimate intra- and inter-observer reproducibility and reliability of assessment of the color content in adnexal masses at color/power Doppler ultrasound examination for observers with different levels of experience, and to determine if they change after a consensus meeting. Methods: Digital clips with color/power Doppler information of 103 adnexal masses were evaluated independently four times, twice before and twice after a consensus meeting, by four experienced and three less experienced ultrasound examiners. The color content of the adnexal mass was estimated using the International Ovarian Tumor Analysis color score and a 100 mm visual analogue scale (VAS score). Intraobserver repeatability was estimated for each... (More)
- Objectives: To estimate intra- and inter-observer reproducibility and reliability of assessment of the color content in adnexal masses at color/power Doppler ultrasound examination for observers with different levels of experience, and to determine if they change after a consensus meeting. Methods: Digital clips with color/power Doppler information of 103 adnexal masses were evaluated independently four times, twice before and twice after a consensus meeting, by four experienced and three less experienced ultrasound examiners. The color content of the adnexal mass was estimated using the International Ovarian Tumor Analysis color score and a 100 mm visual analogue scale (VAS score). Intraobserver repeatability was estimated for each observer. Interobserver agreement was estimated for the four most experienced observers (six pairs), for the three less experienced observers (three pairs), and for four other pairs of observers, each pair consisting of one of the experienced and one of the less-experienced observers. Results: Intra- and inter-observer agreement for the color score was moderate to very good, percentage agreement ranging from 48% to 82.5% (Kappa 0.52-0.82) before and from 59% to 90% (Kappa 0.60-0.88) after the consensus meeting. For seven of 13 pairs of observers, interobserver agreement improved after the consensus meeting. Intra-observer intraclass correlation coefficient (ICC) values for the VAS score ranged from 0.80 to 0.92 before and from 0.75 to 0.94 after the consensus meeting, but limits of agreement were wide (+/-20-35 mm). For six of the seven observers the ICC values were higher after the consensus meeting than before. Inter-observer ICC values for the VAS score ranged from 0.77 to 0.88 before and from 0.77 to 0.91 after the consensus meeting, but limits of agreement were wide (+/-30-40 mm). For ten of 13 pairs of observers the ICC values improved after the consensus meeting. Conclusions: Intra-and inter-observer agreement for the color score was good, especially after the consensus meeting, but there is room for improvement. VAS score results varied substantially within and between observers both before and after the consensus meeting. General consensus needs to be reached about how to interpret color/power Doppler ultrasound findings in adnexal masses. Copyright © 2012 ISUOG. Published by John Wiley & Sons, Ltd. (Less)
Please use this url to cite or link to this publication:
https://lup.lub.lu.se/record/3160716
- author
- Zannoni, L
; Savelli, L
; Jokubkiene, Ligita
LU
; Di Legge, A
; Condous, G
; Testa, A C
; Sladkevicius, Povilas
LU
and Valentin, Lil
LU
- organization
- publishing date
- 2013
- type
- Contribution to journal
- publication status
- published
- subject
- in
- Ultrasound in Obstetrics & Gynecology
- volume
- 42
- issue
- 1
- pages
- 93 - 101
- publisher
- John Wiley & Sons Inc.
- external identifiers
-
- wos:000320778500014
- pmid:23065868
- scopus:84879502349
- pmid:23065868
- ISSN
- 1469-0705
- DOI
- 10.1002/uog.12324
- language
- English
- LU publication?
- yes
- id
- 9ac1c7b2-8d27-440e-8086-b274b1db78ab (old id 3160716)
- alternative location
- http://www.ncbi.nlm.nih.gov/pubmed/23065868?dopt=Abstract
- date added to LUP
- 2016-04-01 10:14:06
- date last changed
- 2022-04-12 03:18:46
@article{9ac1c7b2-8d27-440e-8086-b274b1db78ab,
abstract = {{Objectives: To estimate intra- and inter-observer reproducibility and reliability of assessment of the color content in adnexal masses at color/power Doppler ultrasound examination for observers with different levels of experience, and to determine if they change after a consensus meeting. Methods: Digital clips with color/power Doppler information of 103 adnexal masses were evaluated independently four times, twice before and twice after a consensus meeting, by four experienced and three less experienced ultrasound examiners. The color content of the adnexal mass was estimated using the International Ovarian Tumor Analysis color score and a 100 mm visual analogue scale (VAS score). Intraobserver repeatability was estimated for each observer. Interobserver agreement was estimated for the four most experienced observers (six pairs), for the three less experienced observers (three pairs), and for four other pairs of observers, each pair consisting of one of the experienced and one of the less-experienced observers. Results: Intra- and inter-observer agreement for the color score was moderate to very good, percentage agreement ranging from 48% to 82.5% (Kappa 0.52-0.82) before and from 59% to 90% (Kappa 0.60-0.88) after the consensus meeting. For seven of 13 pairs of observers, interobserver agreement improved after the consensus meeting. Intra-observer intraclass correlation coefficient (ICC) values for the VAS score ranged from 0.80 to 0.92 before and from 0.75 to 0.94 after the consensus meeting, but limits of agreement were wide (+/-20-35 mm). For six of the seven observers the ICC values were higher after the consensus meeting than before. Inter-observer ICC values for the VAS score ranged from 0.77 to 0.88 before and from 0.77 to 0.91 after the consensus meeting, but limits of agreement were wide (+/-30-40 mm). For ten of 13 pairs of observers the ICC values improved after the consensus meeting. Conclusions: Intra-and inter-observer agreement for the color score was good, especially after the consensus meeting, but there is room for improvement. VAS score results varied substantially within and between observers both before and after the consensus meeting. General consensus needs to be reached about how to interpret color/power Doppler ultrasound findings in adnexal masses. Copyright © 2012 ISUOG. Published by John Wiley & Sons, Ltd.}},
author = {{Zannoni, L and Savelli, L and Jokubkiene, Ligita and Di Legge, A and Condous, G and Testa, A C and Sladkevicius, Povilas and Valentin, Lil}},
issn = {{1469-0705}},
language = {{eng}},
number = {{1}},
pages = {{93--101}},
publisher = {{John Wiley & Sons Inc.}},
series = {{Ultrasound in Obstetrics & Gynecology}},
title = {{Intra- and inter-observer reproducibility of assessment of Doppler ultrasound findings in adnexal masses.}},
url = {{http://dx.doi.org/10.1002/uog.12324}},
doi = {{10.1002/uog.12324}},
volume = {{42}},
year = {{2013}},
}