Ultrasound methods to distinguish between malignant and benign adnexal masses in the hands of examiners with different levels of experience
(2009) In Ultrasound in Obstetrics & Gynecology 34(4). p.454-461- Abstract
- Objectives To determine the effect of an ultrasound training course on the performance of pattern recognition when used by less experienced examiners and to compare the performance of pattern recognition, a logistic regression model and a scoring system to estimate the risk of malignancy between examiners with different levels of experience. Methods Using ultrasound images of selected adnexal masses, two trainees classified the masses as benign or malignant by using pattern recognition both before and after they bad attended a theoretical gynecological ultrasound course. They also classified the masses by using a logistic regression model and a scoring system, but only after they bad attended the course. The performance of these three... (More)
- Objectives To determine the effect of an ultrasound training course on the performance of pattern recognition when used by less experienced examiners and to compare the performance of pattern recognition, a logistic regression model and a scoring system to estimate the risk of malignancy between examiners with different levels of experience. Methods Using ultrasound images of selected adnexal masses, two trainees classified the masses as benign or malignant by using pattern recognition both before and after they bad attended a theoretical gynecological ultrasound course. They also classified the masses by using a logistic regression model and a scoring system, but only after they bad attended the course. The performance of these three methods when they were used by the trainees was then compared with that when they were used by experts. Results One hundred and sixty-five adnexal masses were included, of which 42% were malignant (21% invasive tumors and 21% borderline tumors). The area under the receiver- operating characteristics curve of pattern recognition when used by the trainees was similar before and after they had attended the course. Training decreased sensitivity (84% vs. 70% for Trainee 1, P = 0.004; 70% vs. 61% for Trainee2, P = 0.08) and increased specificity (77% vs. 92% for Trainee 1, P = 0.001; 89% vs. 95% for Trainee 2, P = 0.058). The performance of pattern recognition was poorer in the hands of the trainees than in the bands of the experts. The sensitivities of the logistic regression model were 70% and 54% for the trainees vs. 83% for an expert (P = 0.020 and < 0.001, respectively) and the specificities were 84% and 94% vs. 89% (P = 0.25 and 0.59, respectively). The sensitivities of the scoring system were 59% and 54% for the trainees vs. 75% for the expert (P = 0.002 and < 0.001, respectively), and the specificities were 90% and 93% vs. 85% (P = 0.103 and 0.008, respectively). Conclusion Theoretical ultrasound teaching did not seem to improve the performance of pattern recognition in the bands of trainees. A logistic regression model and a scoring system to classify adnexal masses as benign or malignant perform less well when they were used by inexperienced examiners than when used by an expert. Before using a model or a scoring system, experience and/or proper training are likely to be of paramount importance if diagnostic performance is to be optimized. Copyright (C) 2009 ISUOG. Published by John Wiley & Sons, Ltd. (Less)
Please use this url to cite or link to this publication:
https://lup.lub.lu.se/record/1505230
- author
- Van Holsbeke, C.
; Daemen, A.
; Yazbek, J.
; Holland, T. K.
; Bourne, T.
; Mesens, T.
; Lannoo, L.
; De Moor, B.
; De Jonge, E.
; Testa, A. C.
; Valentin, Lil
LU
; Jurkovic, D.
and Timmerman, D.
(Less) - organization
- publishing date
- 2009
- type
- Contribution to journal
- publication status
- published
- subject
- keywords
- models, statistical, risk of malignancy, ovarian neoplasms, pattern recognition, subjective impression, ultrasound
- in
- Ultrasound in Obstetrics & Gynecology
- volume
- 34
- issue
- 4
- pages
- 454 - 461
- publisher
- John Wiley & Sons Inc.
- external identifiers
-
- wos:000271088000016
- scopus:70350234475
- pmid:19736644
- ISSN
- 1469-0705
- DOI
- 10.1002/uog.6443
- language
- English
- LU publication?
- yes
- id
- 995b9a5a-43e6-4236-992c-e4628ad3cd15 (old id 1505230)
- date added to LUP
- 2016-04-01 13:42:55
- date last changed
- 2022-03-21 20:03:45
@article{995b9a5a-43e6-4236-992c-e4628ad3cd15,
abstract = {{Objectives To determine the effect of an ultrasound training course on the performance of pattern recognition when used by less experienced examiners and to compare the performance of pattern recognition, a logistic regression model and a scoring system to estimate the risk of malignancy between examiners with different levels of experience. Methods Using ultrasound images of selected adnexal masses, two trainees classified the masses as benign or malignant by using pattern recognition both before and after they bad attended a theoretical gynecological ultrasound course. They also classified the masses by using a logistic regression model and a scoring system, but only after they bad attended the course. The performance of these three methods when they were used by the trainees was then compared with that when they were used by experts. Results One hundred and sixty-five adnexal masses were included, of which 42% were malignant (21% invasive tumors and 21% borderline tumors). The area under the receiver- operating characteristics curve of pattern recognition when used by the trainees was similar before and after they had attended the course. Training decreased sensitivity (84% vs. 70% for Trainee 1, P = 0.004; 70% vs. 61% for Trainee2, P = 0.08) and increased specificity (77% vs. 92% for Trainee 1, P = 0.001; 89% vs. 95% for Trainee 2, P = 0.058). The performance of pattern recognition was poorer in the hands of the trainees than in the bands of the experts. The sensitivities of the logistic regression model were 70% and 54% for the trainees vs. 83% for an expert (P = 0.020 and < 0.001, respectively) and the specificities were 84% and 94% vs. 89% (P = 0.25 and 0.59, respectively). The sensitivities of the scoring system were 59% and 54% for the trainees vs. 75% for the expert (P = 0.002 and < 0.001, respectively), and the specificities were 90% and 93% vs. 85% (P = 0.103 and 0.008, respectively). Conclusion Theoretical ultrasound teaching did not seem to improve the performance of pattern recognition in the bands of trainees. A logistic regression model and a scoring system to classify adnexal masses as benign or malignant perform less well when they were used by inexperienced examiners than when used by an expert. Before using a model or a scoring system, experience and/or proper training are likely to be of paramount importance if diagnostic performance is to be optimized. Copyright (C) 2009 ISUOG. Published by John Wiley & Sons, Ltd.}},
author = {{Van Holsbeke, C. and Daemen, A. and Yazbek, J. and Holland, T. K. and Bourne, T. and Mesens, T. and Lannoo, L. and De Moor, B. and De Jonge, E. and Testa, A. C. and Valentin, Lil and Jurkovic, D. and Timmerman, D.}},
issn = {{1469-0705}},
keywords = {{models; statistical; risk of malignancy; ovarian neoplasms; pattern recognition; subjective impression; ultrasound}},
language = {{eng}},
number = {{4}},
pages = {{454--461}},
publisher = {{John Wiley & Sons Inc.}},
series = {{Ultrasound in Obstetrics & Gynecology}},
title = {{Ultrasound methods to distinguish between malignant and benign adnexal masses in the hands of examiners with different levels of experience}},
url = {{http://dx.doi.org/10.1002/uog.6443}},
doi = {{10.1002/uog.6443}},
volume = {{34}},
year = {{2009}},
}