Development and evaluation of a deep learning based artificial intelligence for automatic identification of gold fiducial markers in an MRI-only prostate radiotherapy workflow
(2020) In Physics in Medicine and Biology 65(22).- Abstract
Identification of prostate gold fiducial markers in magnetic resonance imaging (MRI) images is challenging when CT images are not available, due to misclassifications from intra-prostatic calcifications. It is also a time consuming task and automated identification methods have been suggested as an improvement for both objectives. Multi-echo gradient echo (MEGRE) images have been utilized for manual fiducial identification with 100% detection accuracy. The aim is therefore to develop an automatic deep learning based method for fiducial identification in MRI images intended for MRI-only prostate radiotherapy. MEGRE images from 326 prostate cancer patients with fiducials were acquired on a 3T MRI, post-processed with N4 bias correction,... (More)
Identification of prostate gold fiducial markers in magnetic resonance imaging (MRI) images is challenging when CT images are not available, due to misclassifications from intra-prostatic calcifications. It is also a time consuming task and automated identification methods have been suggested as an improvement for both objectives. Multi-echo gradient echo (MEGRE) images have been utilized for manual fiducial identification with 100% detection accuracy. The aim is therefore to develop an automatic deep learning based method for fiducial identification in MRI images intended for MRI-only prostate radiotherapy. MEGRE images from 326 prostate cancer patients with fiducials were acquired on a 3T MRI, post-processed with N4 bias correction, and the fiducial center of mass (CoM) was identified. A 9 mm radius sphere was created around the CoM as ground truth. A deep learning HighRes3DNet model for semantic segmentation was trained using image augmentation. The model was applied to 39 MRI-only patients and 3D probability maps for fiducial location and segmentation were produced and spatially smoothed. In each of the three largest probability peaks, a 9 mm radius sphere was defined. Detection sensitivity and geometric accuracy was assessed. To raise awareness of potential false findings a 'BeAware' score was developed, calculated from the total number and quality of the probability peaks. All datasets, annotations and source code used were made publicly available. The detection sensitivity for all fiducials were 97.4%. Thirty-six out of thirty-nine patients had all fiducial markers correctly identified. All three failed patients generated a user notification using the BeAware score. The mean absolute difference between the detected fiducial and ground truth CoM was 0.7 ± 0.9 [0 3.1] mm. A deep learning method for automatic fiducial identification in MRI images was developed and evaluated with state-of-the-art results. The BeAware score has the potential to notify the user regarding patients where the proposed method is uncertain.
(Less)
- author
- Gustafsson, Christian Jamtheim LU ; Swärd, Johan ; Adalbjörnsson, Stefan Ingi LU ; Jakobsson, Andreas LU and Olsson, Lars E LU
- organization
-
- LUCC: Lund University Cancer Centre
- Radiotherapy Physics (research group)
- Medical Radiation Physics, Malmö (research group)
- Medical Radiation Physics, Lund
- eSSENCE: The e-Science Collaboration
- Mathematical Statistics
- Biomedical Modelling and Computation (research group)
- Statistical Signal Processing Group (research group)
- publishing date
- 2020-11-12
- type
- Contribution to journal
- publication status
- published
- subject
- in
- Physics in Medicine and Biology
- volume
- 65
- issue
- 22
- article number
- 225011
- publisher
- IOP Publishing
- external identifiers
-
- scopus:85096593628
- pmid:33179610
- ISSN
- 1361-6560
- DOI
- 10.1088/1361-6560/abb0f9
- language
- English
- LU publication?
- yes
- id
- 7d1efabc-ad0d-431e-a6e5-bd555eaaa42a
- date added to LUP
- 2020-11-18 15:48:08
- date last changed
- 2024-10-17 14:27:46
@article{7d1efabc-ad0d-431e-a6e5-bd555eaaa42a, abstract = {{<p>Identification of prostate gold fiducial markers in magnetic resonance imaging (MRI) images is challenging when CT images are not available, due to misclassifications from intra-prostatic calcifications. It is also a time consuming task and automated identification methods have been suggested as an improvement for both objectives. Multi-echo gradient echo (MEGRE) images have been utilized for manual fiducial identification with 100% detection accuracy. The aim is therefore to develop an automatic deep learning based method for fiducial identification in MRI images intended for MRI-only prostate radiotherapy. MEGRE images from 326 prostate cancer patients with fiducials were acquired on a 3T MRI, post-processed with N4 bias correction, and the fiducial center of mass (CoM) was identified. A 9 mm radius sphere was created around the CoM as ground truth. A deep learning HighRes3DNet model for semantic segmentation was trained using image augmentation. The model was applied to 39 MRI-only patients and 3D probability maps for fiducial location and segmentation were produced and spatially smoothed. In each of the three largest probability peaks, a 9 mm radius sphere was defined. Detection sensitivity and geometric accuracy was assessed. To raise awareness of potential false findings a 'BeAware' score was developed, calculated from the total number and quality of the probability peaks. All datasets, annotations and source code used were made publicly available. The detection sensitivity for all fiducials were 97.4%. Thirty-six out of thirty-nine patients had all fiducial markers correctly identified. All three failed patients generated a user notification using the BeAware score. The mean absolute difference between the detected fiducial and ground truth CoM was 0.7 ± 0.9 [0 3.1] mm. A deep learning method for automatic fiducial identification in MRI images was developed and evaluated with state-of-the-art results. The BeAware score has the potential to notify the user regarding patients where the proposed method is uncertain.</p>}}, author = {{Gustafsson, Christian Jamtheim and Swärd, Johan and Adalbjörnsson, Stefan Ingi and Jakobsson, Andreas and Olsson, Lars E}}, issn = {{1361-6560}}, language = {{eng}}, month = {{11}}, number = {{22}}, publisher = {{IOP Publishing}}, series = {{Physics in Medicine and Biology}}, title = {{Development and evaluation of a deep learning based artificial intelligence for automatic identification of gold fiducial markers in an MRI-only prostate radiotherapy workflow}}, url = {{http://dx.doi.org/10.1088/1361-6560/abb0f9}}, doi = {{10.1088/1361-6560/abb0f9}}, volume = {{65}}, year = {{2020}}, }