Deep Learning for Predicting Progression of Patellofemoral Osteoarthritis Based on Lateral Knee Radiographs, Demographic Data and Symptomatic Assessments
Bayramoglu, Neslihan ; Englund, Martin LU
; Haugen, Ida K.
; Ishijima, Muneaki
and Saarakkala, Simo
(2023)
In Methods of Information in Medicine
- Abstract
Objective: In this study, we propose a novel framework that utilizes deep learning and attention mechanisms to predict the radiographic progression of patellofemoral osteoarthritis (PFOA) over a period of seven years. Design: This study included subjects (1832 subjects, 3276 knees) from the baseline of the Multicenter Osteoarthritis Study (MOST). Patellofemoral joint regions-of interest were identified using an automated landmark detection tool (BoneFinder) on lateral knee X-rays. An end-to-end deep learning method was developed for predicting PFOA progression based on imaging data in a 5-fold cross-validation setting. To evaluate the performance of the models, a set of baselines based on known risk factors were developed and analyzed... (More)
Objective: In this study, we propose a novel framework that utilizes deep learning and attention mechanisms to predict the radiographic progression of patellofemoral osteoarthritis (PFOA) over a period of seven years. Design: This study included subjects (1832 subjects, 3276 knees) from the baseline of the Multicenter Osteoarthritis Study (MOST). Patellofemoral joint regions-of interest were identified using an automated landmark detection tool (BoneFinder) on lateral knee X-rays. An end-to-end deep learning method was developed for predicting PFOA progression based on imaging data in a 5-fold cross-validation setting. To evaluate the performance of the models, a set of baselines based on known risk factors were developed and analyzed using gradient boosting machine (GBM). Risk factors included age, sex, BMI and WOMAC score, and the radiographic osteoarthritis stage of the tibiofemoral joint (KL score). Finally, to increase predictive power, we trained an ensemble model using both imaging and clinical data. Results: Among the individual models, the performance of our deep convolutional neural network attention model achieved the best performance with an AUC of 0.856 and AP of 0.431; slightly outperforming the deep learning approach without attention (AUC=0.832, AP= 0.4) and the best performing reference GBM model (AUC=0.767, AP= 0.334). The inclusion of imaging data and clinical variables in an ensemble model allowed statistically more powerful prediction of PFOA progression (AUC = 0.865, AP=0.447), although the clinical significance of this minor performance gain remains unknown. The spatial attention module improved the predictive performance of the backbone model, and the visual interpretation of attention maps focused on the joint space and the regions where osteophytes typically occur. Conclusion: This study demonstrated the potential of machine learning models to predict the progression of PFOA using imaging and clinical variables. These models could be used to identify patients who are at high risk of progression and prioritize them for new treatments. However, even though the accuracy of the models were excellent in this study using the MOST dataset, they should be still validated using external patient cohorts in the future.
(Less)
- author
- Bayramoglu, Neslihan
; Englund, Martin
LU
; Haugen, Ida K.
; Ishijima, Muneaki
and Saarakkala, Simo
- organization
- publishing date
- 2023
- type
- Contribution to journal
- publication status
- epub
- subject
- keywords
- Deep Learning, Knee, Patellofemoral Osteoarthritis, Prediction of Osteoarthritis Progression
- in
- Methods of Information in Medicine
- publisher
- Schattauer GmbH
- external identifiers
-
- scopus:85191036130
- ISSN
- 0026-1270
- DOI
- 10.1055/a-2305-2115
- language
- English
- LU publication?
- yes
- id
- 7286084b-bf2e-43fa-9c3a-a67ba4f569eb
- date added to LUP
- 2024-05-08 11:24:36
- date last changed
- 2024-05-08 11:25:13
@article{7286084b-bf2e-43fa-9c3a-a67ba4f569eb,
abstract = {{<p>Objective: In this study, we propose a novel framework that utilizes deep learning and attention mechanisms to predict the radiographic progression of patellofemoral osteoarthritis (PFOA) over a period of seven years. Design: This study included subjects (1832 subjects, 3276 knees) from the baseline of the Multicenter Osteoarthritis Study (MOST). Patellofemoral joint regions-of interest were identified using an automated landmark detection tool (BoneFinder) on lateral knee X-rays. An end-to-end deep learning method was developed for predicting PFOA progression based on imaging data in a 5-fold cross-validation setting. To evaluate the performance of the models, a set of baselines based on known risk factors were developed and analyzed using gradient boosting machine (GBM). Risk factors included age, sex, BMI and WOMAC score, and the radiographic osteoarthritis stage of the tibiofemoral joint (KL score). Finally, to increase predictive power, we trained an ensemble model using both imaging and clinical data. Results: Among the individual models, the performance of our deep convolutional neural network attention model achieved the best performance with an AUC of 0.856 and AP of 0.431; slightly outperforming the deep learning approach without attention (AUC=0.832, AP= 0.4) and the best performing reference GBM model (AUC=0.767, AP= 0.334). The inclusion of imaging data and clinical variables in an ensemble model allowed statistically more powerful prediction of PFOA progression (AUC = 0.865, AP=0.447), although the clinical significance of this minor performance gain remains unknown. The spatial attention module improved the predictive performance of the backbone model, and the visual interpretation of attention maps focused on the joint space and the regions where osteophytes typically occur. Conclusion: This study demonstrated the potential of machine learning models to predict the progression of PFOA using imaging and clinical variables. These models could be used to identify patients who are at high risk of progression and prioritize them for new treatments. However, even though the accuracy of the models were excellent in this study using the MOST dataset, they should be still validated using external patient cohorts in the future.</p>}},
author = {{Bayramoglu, Neslihan and Englund, Martin and Haugen, Ida K. and Ishijima, Muneaki and Saarakkala, Simo}},
issn = {{0026-1270}},
keywords = {{Deep Learning; Knee; Patellofemoral Osteoarthritis; Prediction of Osteoarthritis Progression}},
language = {{eng}},
publisher = {{Schattauer GmbH}},
series = {{Methods of Information in Medicine}},
title = {{Deep Learning for Predicting Progression of Patellofemoral Osteoarthritis Based on Lateral Knee Radiographs, Demographic Data and Symptomatic Assessments}},
url = {{http://dx.doi.org/10.1055/a-2305-2115}},
doi = {{10.1055/a-2305-2115}},
year = {{2023}},
}