Skip to main content

Lund University Publications

LUND UNIVERSITY LIBRARIES

Deep learning-based classification and structure name standardization for organ at risk and target delineations in prostate cancer radiotherapy

Jamtheim Gustafsson, Christian LU ; Lempart, Michael LU ; Swärd, Johan LU ; Persson, Emilia LU ; Nyholm, Tufve ; Thellenberg Karlsson, Camilla and Scherman, Jonas (2021) In Journal of Applied Clinical Medical Physics 22(12). p.51-63
Abstract

Radiotherapy (RT) datasets can suffer from variations in annotation of organ at risk (OAR) and target structures. Annotation standards exist, but their description for prostate targets is limited. This restricts the use of such data for supervised machine learning purposes as it requires properly annotated data. The aim of this work was to develop a modality independent deep learning (DL) model for automatic classification and annotation of prostate RT DICOM structures. Delineated prostate organs at risk (OAR), support- and target structures (gross tumor volume [GTV]/clinical target volume [CTV]/planning target volume [PTV]), along with or without separate vesicles and/or lymph nodes, were extracted as binary masks from 1854 patients.... (More)

Radiotherapy (RT) datasets can suffer from variations in annotation of organ at risk (OAR) and target structures. Annotation standards exist, but their description for prostate targets is limited. This restricts the use of such data for supervised machine learning purposes as it requires properly annotated data. The aim of this work was to develop a modality independent deep learning (DL) model for automatic classification and annotation of prostate RT DICOM structures. Delineated prostate organs at risk (OAR), support- and target structures (gross tumor volume [GTV]/clinical target volume [CTV]/planning target volume [PTV]), along with or without separate vesicles and/or lymph nodes, were extracted as binary masks from 1854 patients. An image modality independent 2D InceptionResNetV2 classification network was trained with varying amounts of training data using four image input channels. Channel 1–3 consisted of orthogonal 2D projections from each individual binary structure. The fourth channel contained a summation of the other available binary structure masks. Structure classification performance was assessed in independent CT (n = 200 pat) and magnetic resonance imaging (MRI) (n = 40 pat) test datasets and an external CT (n = 99 pat) dataset from another clinic. A weighted classification accuracy of 99.4% was achieved during training. The unweighted classification accuracy and the weighted average F1 score among different structures in the CT test dataset were 98.8% and 98.4% and 98.6% and 98.5% for the MRI test dataset, respectively. The external CT dataset yielded the corresponding results 98.4% and 98.7% when analyzed for trained structures only, and results from the full dataset yielded 79.6% and 75.2%. Most misclassifications in the external CT dataset occurred due to multiple CTVs and PTVs being fused together, which was not included in the training data. Our proposed DL-based method for automated renaming and standardization of prostate radiotherapy annotations shows great potential. Clinic specific contouring standards however need to be represented in the training data for successful use. Source code is available at https://github.com/jamtheim/DicomRTStructRenamerPublic.

(Less)
Please use this url to cite or link to this publication:
author
; ; ; ; ; and
organization
publishing date
type
Contribution to journal
publication status
published
subject
keywords
classification, deep learning, machine learning, radiotherapy, structure
in
Journal of Applied Clinical Medical Physics
volume
22
issue
12
pages
51 - 63
publisher
American College of Medical Physics
external identifiers
  • scopus:85116543880
  • pmid:34623738
ISSN
1526-9914
DOI
10.1002/acm2.13446
language
English
LU publication?
yes
additional info
Publisher Copyright: © 2021 The Authors. Journal of Applied Clinical Medical Physics published by Wiley Periodicals, LLC on behalf of The American Association of Physicists in Medicine
id
891f8de3-b931-42d8-b23e-b75b14c984b8
date added to LUP
2021-10-27 11:01:50
date last changed
2024-06-01 18:37:45
@article{891f8de3-b931-42d8-b23e-b75b14c984b8,
  abstract     = {{<p>Radiotherapy (RT) datasets can suffer from variations in annotation of organ at risk (OAR) and target structures. Annotation standards exist, but their description for prostate targets is limited. This restricts the use of such data for supervised machine learning purposes as it requires properly annotated data. The aim of this work was to develop a modality independent deep learning (DL) model for automatic classification and annotation of prostate RT DICOM structures. Delineated prostate organs at risk (OAR), support- and target structures (gross tumor volume [GTV]/clinical target volume [CTV]/planning target volume [PTV]), along with or without separate vesicles and/or lymph nodes, were extracted as binary masks from 1854 patients. An image modality independent 2D InceptionResNetV2 classification network was trained with varying amounts of training data using four image input channels. Channel 1–3 consisted of orthogonal 2D projections from each individual binary structure. The fourth channel contained a summation of the other available binary structure masks. Structure classification performance was assessed in independent CT (n = 200 pat) and magnetic resonance imaging (MRI) (n = 40 pat) test datasets and an external CT (n = 99 pat) dataset from another clinic. A weighted classification accuracy of 99.4% was achieved during training. The unweighted classification accuracy and the weighted average F1 score among different structures in the CT test dataset were 98.8% and 98.4% and 98.6% and 98.5% for the MRI test dataset, respectively. The external CT dataset yielded the corresponding results 98.4% and 98.7% when analyzed for trained structures only, and results from the full dataset yielded 79.6% and 75.2%. Most misclassifications in the external CT dataset occurred due to multiple CTVs and PTVs being fused together, which was not included in the training data. Our proposed DL-based method for automated renaming and standardization of prostate radiotherapy annotations shows great potential. Clinic specific contouring standards however need to be represented in the training data for successful use. Source code is available at https://github.com/jamtheim/DicomRTStructRenamerPublic.</p>}},
  author       = {{Jamtheim Gustafsson, Christian and Lempart, Michael and Swärd, Johan and Persson, Emilia and Nyholm, Tufve and Thellenberg Karlsson, Camilla and Scherman, Jonas}},
  issn         = {{1526-9914}},
  keywords     = {{classification; deep learning; machine learning; radiotherapy; structure}},
  language     = {{eng}},
  number       = {{12}},
  pages        = {{51--63}},
  publisher    = {{American College of Medical Physics}},
  series       = {{Journal of Applied Clinical Medical Physics}},
  title        = {{Deep learning-based classification and structure name standardization for organ at risk and target delineations in prostate cancer radiotherapy}},
  url          = {{http://dx.doi.org/10.1002/acm2.13446}},
  doi          = {{10.1002/acm2.13446}},
  volume       = {{22}},
  year         = {{2021}},
}