Confidence of expert ultrasound operators in making a diagnosis of adnexal tumor: effect on diagnostic accuracy and interobserver agreement
Yazbek, J. ; Ameye, L. ; Testa, A. C. ; Valentin, Lil LU
; Timmerman, D.
; Holland, T. K.
; Van Holsbeke, C.
and Jurkovic, D.
(2010)
In Ultrasound in Obstetrics & Gynecology
35(1).
p.89-93
- Abstract
- Objective To assess the degree of confidence with which expert ultrasound operators make a diagnosis of benign, borderline and invasive malignant ovarian tumors and its effect on diagnostic accuracy and interobserver agreement. Method Digitally stored static two-dimensional B-mode images of representative cases of benign, borderline and invasive malignant ovarian tumors were independently assessed by three expert ultrasound operators who bad not performed the original real-time ultrasound examination. The experts classified the tumors as benign, borderline or invasive malignant and they also indicated the degree of confidence with which they made the diagnosis (certain, probable and uncertain). The diagnostic accuracy and interobserver... (More)
- Objective To assess the degree of confidence with which expert ultrasound operators make a diagnosis of benign, borderline and invasive malignant ovarian tumors and its effect on diagnostic accuracy and interobserver agreement. Method Digitally stored static two-dimensional B-mode images of representative cases of benign, borderline and invasive malignant ovarian tumors were independently assessed by three expert ultrasound operators who bad not performed the original real-time ultrasound examination. The experts classified the tumors as benign, borderline or invasive malignant and they also indicated the degree of confidence with which they made the diagnosis (certain, probable and uncertain). The diagnostic accuracy and interobserver agreement, in differentiating benign, borderline and invasive malignant ovarian tumors, were calculated depending on the level of confidence with which the diagnosis was made. Results One hundred and sixty-six cases were included in the final data analysis. The diagnostic accuracy of all three experts decreased with decreasing level of confidence. Interobserver agreement between any two experts was very high when they were certain of the diagnosis (rates of agreement 98%, 99% and 100%), but it was significantly lower with a moderate level of confidence (rates of agreement 78%, 71% and 76%) (P < 0.01 for any two experts). The agreement in both diagnosis and confidence was lowest in cases of borderline ovarian tumors compared to benign and primary invasive lesions. Conclusions The accuracy of expert ultrasound operators using pattern recognition depends on the degree of certainty with which the diagnosis is made. Interobserver variability is also influenced by the operators' confidence in making the diagnosis. Our findings suggest that the level of confidence with which the diagnosis is made should be included in the ultrasound report. Copyright (c) 2009 ISUOG. Published by John Wiley &Sons, Ltd. (Less)
Please use this url to cite or link to this publication:
https://lup.lub.lu.se/record/1547421
- author
- Yazbek, J.
; Ameye, L.
; Testa, A. C.
; Valentin, Lil
LU
; Timmerman, D.
; Holland, T. K.
; Van Holsbeke, C.
and Jurkovic, D.
- organization
- publishing date
- 2010
- type
- Contribution to journal
- publication status
- published
- subject
- keywords
- ovarian neoplasms, interobserver agreement, confidence, diagnosis, ultrasound pattern recognition
- in
- Ultrasound in Obstetrics & Gynecology
- volume
- 35
- issue
- 1
- pages
- 89 - 93
- publisher
- John Wiley & Sons Inc.
- external identifiers
-
- wos:000273679800015
- scopus:74049162431
- pmid:19757401
- ISSN
- 1469-0705
- DOI
- 10.1002/uog.7335
- language
- English
- LU publication?
- yes
- id
- 5a1eddea-2bf2-4351-9445-d29fd0595257 (old id 1547421)
- date added to LUP
- 2016-04-01 13:44:32
- date last changed
- 2022-03-29 17:05:47
@article{5a1eddea-2bf2-4351-9445-d29fd0595257,
abstract = {{Objective To assess the degree of confidence with which expert ultrasound operators make a diagnosis of benign, borderline and invasive malignant ovarian tumors and its effect on diagnostic accuracy and interobserver agreement. Method Digitally stored static two-dimensional B-mode images of representative cases of benign, borderline and invasive malignant ovarian tumors were independently assessed by three expert ultrasound operators who bad not performed the original real-time ultrasound examination. The experts classified the tumors as benign, borderline or invasive malignant and they also indicated the degree of confidence with which they made the diagnosis (certain, probable and uncertain). The diagnostic accuracy and interobserver agreement, in differentiating benign, borderline and invasive malignant ovarian tumors, were calculated depending on the level of confidence with which the diagnosis was made. Results One hundred and sixty-six cases were included in the final data analysis. The diagnostic accuracy of all three experts decreased with decreasing level of confidence. Interobserver agreement between any two experts was very high when they were certain of the diagnosis (rates of agreement 98%, 99% and 100%), but it was significantly lower with a moderate level of confidence (rates of agreement 78%, 71% and 76%) (P < 0.01 for any two experts). The agreement in both diagnosis and confidence was lowest in cases of borderline ovarian tumors compared to benign and primary invasive lesions. Conclusions The accuracy of expert ultrasound operators using pattern recognition depends on the degree of certainty with which the diagnosis is made. Interobserver variability is also influenced by the operators' confidence in making the diagnosis. Our findings suggest that the level of confidence with which the diagnosis is made should be included in the ultrasound report. Copyright (c) 2009 ISUOG. Published by John Wiley &Sons, Ltd.}},
author = {{Yazbek, J. and Ameye, L. and Testa, A. C. and Valentin, Lil and Timmerman, D. and Holland, T. K. and Van Holsbeke, C. and Jurkovic, D.}},
issn = {{1469-0705}},
keywords = {{ovarian neoplasms; interobserver agreement; confidence; diagnosis; ultrasound pattern recognition}},
language = {{eng}},
number = {{1}},
pages = {{89--93}},
publisher = {{John Wiley & Sons Inc.}},
series = {{Ultrasound in Obstetrics & Gynecology}},
title = {{Confidence of expert ultrasound operators in making a diagnosis of adnexal tumor: effect on diagnostic accuracy and interobserver agreement}},
url = {{http://dx.doi.org/10.1002/uog.7335}},
doi = {{10.1002/uog.7335}},
volume = {{35}},
year = {{2010}},
}