Advanced

Inter-observer agreement in describing the ultrasound appearance of adnexal masses and in calculating the risk of malignancy using logistic regression models.

Sladkevicius, Povilas LU and Valentin, Lil LU (2015) In Clinical Cancer Research 21(3). p.594-601
Abstract
Purpose: To estimate inter-observer agreement with regard to describing adnexal masses using the International Ovarian Tumor Analysis (IOTA) terminology and the risk of malignancy calculated using IOTA logistic regression models LR1 and LR2, and to elucidate what explained the largest inter-observer differences in calculated risk of malignancy. Experimental Design: 117 women with adnexal masses were examined with transvaginal gray scale and power Doppler ultrasound by two independent experienced sonologists who described the masses using IOTA terminology. The risk of malignancy was calculated using LR1 and LR2. A predetermined risk of malignancy cutoff of 10% indicated malignancy. Results: There were 94 benign, four borderline and 19... (More)
Purpose: To estimate inter-observer agreement with regard to describing adnexal masses using the International Ovarian Tumor Analysis (IOTA) terminology and the risk of malignancy calculated using IOTA logistic regression models LR1 and LR2, and to elucidate what explained the largest inter-observer differences in calculated risk of malignancy. Experimental Design: 117 women with adnexal masses were examined with transvaginal gray scale and power Doppler ultrasound by two independent experienced sonologists who described the masses using IOTA terminology. The risk of malignancy was calculated using LR1 and LR2. A predetermined risk of malignancy cutoff of 10% indicated malignancy. Results: There were 94 benign, four borderline and 19 invasively malignant tumors. There was substantial variability between the two sonologists in measurement results and some variability in assessment of categorical variables (agreement 40-98%, Kappa 0.30-0.91). Inter-observer agreement when classifying tumors as benign or malignant was 84% (98/117), Kappa 0.68 for LR1, and for LR2 85% (99/117), Kappa 0.68. When using LR1 and LR2 the inter-observer difference in calculated risk was >25 percentage units in 9% (11/117) and 12% (14/117) of tumors, respectively. Differences in assessment of wall irregularity, acoustic shadowing, color score and color flow in papillary projections explained most of these largest differences. Conclusions: Inter-observer agreement in classifying tumors as benign or malignant using the risk of malignancy cut off of 10% for LR1 and LR2 was good. However, because risks estimates may differ substantially between sonologists one should be cautious with using the risk value for counseling patients about their individual risk. (Less)
Please use this url to cite or link to this publication:
author
organization
publishing date
type
Contribution to journal
publication status
published
subject
in
Clinical Cancer Research
volume
21
issue
3
pages
8 pages
publisher
American Association for Cancer Research
external identifiers
  • pmid:25424853
  • wos:000348908500014
  • scopus:84964307448
ISSN
1078-0432
DOI
10.1158/1078-0432.CCR-14-0906
language
English
LU publication?
yes
id
15783e25-f5d1-443b-8c67-0cb1a47d9b69 (old id 4815993)
alternative location
http://www.ncbi.nlm.nih.gov/pubmed/25424853?dopt=Abstract
date added to LUP
2014-12-04 08:58:55
date last changed
2017-01-01 03:28:04
@article{15783e25-f5d1-443b-8c67-0cb1a47d9b69,
  abstract     = {Purpose: To estimate inter-observer agreement with regard to describing adnexal masses using the International Ovarian Tumor Analysis (IOTA) terminology and the risk of malignancy calculated using IOTA logistic regression models LR1 and LR2, and to elucidate what explained the largest inter-observer differences in calculated risk of malignancy. Experimental Design: 117 women with adnexal masses were examined with transvaginal gray scale and power Doppler ultrasound by two independent experienced sonologists who described the masses using IOTA terminology. The risk of malignancy was calculated using LR1 and LR2. A predetermined risk of malignancy cutoff of 10% indicated malignancy. Results: There were 94 benign, four borderline and 19 invasively malignant tumors. There was substantial variability between the two sonologists in measurement results and some variability in assessment of categorical variables (agreement 40-98%, Kappa 0.30-0.91). Inter-observer agreement when classifying tumors as benign or malignant was 84% (98/117), Kappa 0.68 for LR1, and for LR2 85% (99/117), Kappa 0.68. When using LR1 and LR2 the inter-observer difference in calculated risk was >25 percentage units in 9% (11/117) and 12% (14/117) of tumors, respectively. Differences in assessment of wall irregularity, acoustic shadowing, color score and color flow in papillary projections explained most of these largest differences. Conclusions: Inter-observer agreement in classifying tumors as benign or malignant using the risk of malignancy cut off of 10% for LR1 and LR2 was good. However, because risks estimates may differ substantially between sonologists one should be cautious with using the risk value for counseling patients about their individual risk.},
  author       = {Sladkevicius, Povilas and Valentin, Lil},
  issn         = {1078-0432},
  language     = {eng},
  number       = {3},
  pages        = {594--601},
  publisher    = {American Association for Cancer Research},
  series       = {Clinical Cancer Research},
  title        = {Inter-observer agreement in describing the ultrasound appearance of adnexal masses and in calculating the risk of malignancy using logistic regression models.},
  url          = {http://dx.doi.org/10.1158/1078-0432.CCR-14-0906},
  volume       = {21},
  year         = {2015},
}