Advanced

Intra- and inter-observer reproducibility of assessment of Doppler ultrasound findings in adnexal masses.

Zannoni, L ; Savelli, L ; Jokubkiene, Ligita LU ; Di Legge, A ; Condous, G ; Testa, A C ; Sladkevicius, Povilas LU and Valentin, Lil LU (2013) In Ultrasound in Obstetrics & Gynecology 42(1). p.93-101
Abstract
Objectives: To estimate intra- and inter-observer reproducibility and reliability of assessment of the color content in adnexal masses at color/power Doppler ultrasound examination for observers with different levels of experience, and to determine if they change after a consensus meeting. Methods: Digital clips with color/power Doppler information of 103 adnexal masses were evaluated independently four times, twice before and twice after a consensus meeting, by four experienced and three less experienced ultrasound examiners. The color content of the adnexal mass was estimated using the International Ovarian Tumor Analysis color score and a 100 mm visual analogue scale (VAS score). Intraobserver repeatability was estimated for each... (More)
Objectives: To estimate intra- and inter-observer reproducibility and reliability of assessment of the color content in adnexal masses at color/power Doppler ultrasound examination for observers with different levels of experience, and to determine if they change after a consensus meeting. Methods: Digital clips with color/power Doppler information of 103 adnexal masses were evaluated independently four times, twice before and twice after a consensus meeting, by four experienced and three less experienced ultrasound examiners. The color content of the adnexal mass was estimated using the International Ovarian Tumor Analysis color score and a 100 mm visual analogue scale (VAS score). Intraobserver repeatability was estimated for each observer. Interobserver agreement was estimated for the four most experienced observers (six pairs), for the three less experienced observers (three pairs), and for four other pairs of observers, each pair consisting of one of the experienced and one of the less-experienced observers. Results: Intra- and inter-observer agreement for the color score was moderate to very good, percentage agreement ranging from 48% to 82.5% (Kappa 0.52-0.82) before and from 59% to 90% (Kappa 0.60-0.88) after the consensus meeting. For seven of 13 pairs of observers, interobserver agreement improved after the consensus meeting. Intra-observer intraclass correlation coefficient (ICC) values for the VAS score ranged from 0.80 to 0.92 before and from 0.75 to 0.94 after the consensus meeting, but limits of agreement were wide (+/-20-35 mm). For six of the seven observers the ICC values were higher after the consensus meeting than before. Inter-observer ICC values for the VAS score ranged from 0.77 to 0.88 before and from 0.77 to 0.91 after the consensus meeting, but limits of agreement were wide (+/-30-40 mm). For ten of 13 pairs of observers the ICC values improved after the consensus meeting. Conclusions: Intra-and inter-observer agreement for the color score was good, especially after the consensus meeting, but there is room for improvement. VAS score results varied substantially within and between observers both before and after the consensus meeting. General consensus needs to be reached about how to interpret color/power Doppler ultrasound findings in adnexal masses. Copyright © 2012 ISUOG. Published by John Wiley & Sons, Ltd. (Less)
Please use this url to cite or link to this publication:
author
organization
publishing date
type
Contribution to journal
publication status
published
subject
in
Ultrasound in Obstetrics & Gynecology
volume
42
issue
1
pages
93 - 101
publisher
John Wiley & Sons
external identifiers
  • wos:000320778500014
  • pmid:23065868
  • scopus:84879502349
  • pmid:23065868
ISSN
1469-0705
DOI
10.1002/uog.12324
language
English
LU publication?
yes
id
9ac1c7b2-8d27-440e-8086-b274b1db78ab (old id 3160716)
alternative location
http://www.ncbi.nlm.nih.gov/pubmed/23065868?dopt=Abstract
date added to LUP
2016-04-01 10:14:06
date last changed
2020-03-24 01:26:33
@article{9ac1c7b2-8d27-440e-8086-b274b1db78ab,
  abstract     = {Objectives: To estimate intra- and inter-observer reproducibility and reliability of assessment of the color content in adnexal masses at color/power Doppler ultrasound examination for observers with different levels of experience, and to determine if they change after a consensus meeting. Methods: Digital clips with color/power Doppler information of 103 adnexal masses were evaluated independently four times, twice before and twice after a consensus meeting, by four experienced and three less experienced ultrasound examiners. The color content of the adnexal mass was estimated using the International Ovarian Tumor Analysis color score and a 100 mm visual analogue scale (VAS score). Intraobserver repeatability was estimated for each observer. Interobserver agreement was estimated for the four most experienced observers (six pairs), for the three less experienced observers (three pairs), and for four other pairs of observers, each pair consisting of one of the experienced and one of the less-experienced observers. Results: Intra- and inter-observer agreement for the color score was moderate to very good, percentage agreement ranging from 48% to 82.5% (Kappa 0.52-0.82) before and from 59% to 90% (Kappa 0.60-0.88) after the consensus meeting. For seven of 13 pairs of observers, interobserver agreement improved after the consensus meeting. Intra-observer intraclass correlation coefficient (ICC) values for the VAS score ranged from 0.80 to 0.92 before and from 0.75 to 0.94 after the consensus meeting, but limits of agreement were wide (+/-20-35 mm). For six of the seven observers the ICC values were higher after the consensus meeting than before. Inter-observer ICC values for the VAS score ranged from 0.77 to 0.88 before and from 0.77 to 0.91 after the consensus meeting, but limits of agreement were wide (+/-30-40 mm). For ten of 13 pairs of observers the ICC values improved after the consensus meeting. Conclusions: Intra-and inter-observer agreement for the color score was good, especially after the consensus meeting, but there is room for improvement. VAS score results varied substantially within and between observers both before and after the consensus meeting. General consensus needs to be reached about how to interpret color/power Doppler ultrasound findings in adnexal masses. Copyright © 2012 ISUOG. Published by John Wiley & Sons, Ltd.},
  author       = {Zannoni, L and Savelli, L and Jokubkiene, Ligita and Di Legge, A and Condous, G and Testa, A C and Sladkevicius, Povilas and Valentin, Lil},
  issn         = {1469-0705},
  language     = {eng},
  number       = {1},
  pages        = {93--101},
  publisher    = {John Wiley & Sons},
  series       = {Ultrasound in Obstetrics & Gynecology},
  title        = {Intra- and inter-observer reproducibility of assessment of Doppler ultrasound findings in adnexal masses.},
  url          = {http://dx.doi.org/10.1002/uog.12324},
  doi          = {10.1002/uog.12324},
  volume       = {42},
  year         = {2013},
}