Using Artificial Intelligence for Assessment of Velopharyngeal Competence in Children Born With Cleft Palate With or Without Cleft Lip
(2024) In Cleft Palate - Craniofacial Journal- Abstract
- Objective
Development of an AI tool to assess velopharyngeal competence (VPC) in children with cleft palate, with/without cleft lip.
Design
Innovation of an AI tool using retrospective audio recordings and assessments of VPC.
Setting
Two datasets were used. The first, named the SR dataset, included data from follow-up visits to Skåne University Hospital, Sweden. The second, named the SC + IC dataset, was a combined dataset (SC + IC dataset) with data from the Scandcleft randomized trials across five countries and an intercenter study performed at six Swedish CL/P centers.
Participants
SR dataset included 153 recordings from 162 children, and SC + IC dataset included 308 recordings from 399 children. All... (More) - Objective
Development of an AI tool to assess velopharyngeal competence (VPC) in children with cleft palate, with/without cleft lip.
Design
Innovation of an AI tool using retrospective audio recordings and assessments of VPC.
Setting
Two datasets were used. The first, named the SR dataset, included data from follow-up visits to Skåne University Hospital, Sweden. The second, named the SC + IC dataset, was a combined dataset (SC + IC dataset) with data from the Scandcleft randomized trials across five countries and an intercenter study performed at six Swedish CL/P centers.
Participants
SR dataset included 153 recordings from 162 children, and SC + IC dataset included 308 recordings from 399 children. All recordings were from ages 5 or 10, with corresponding VPC assessments.
Interventions
Development of two networks, a convolutional neural network (CNN) and a pre-trained CNN (VGGish). After initial testing using the SR dataset, the networks were re-tested using the SC + IC dataset and modified to improve performance.
Main Outcome Measures
Accuracy of the networks' VPC scores, with speech and language pathologistś scores seen as the true values. A three-point scale was used for VPC assessments.
Results
VGGish outperformed CNN, achieving 57.1% accuracy compared to 39.8%. Minor adjustments in data pre-processing and network characteristics improved accuracies.
Conclusions
Network accuracies were too low for the networks to be useful alternatives for VPC assessment in clinical practice. Suggestions for future research with regards to study design and dataset optimization were discussed. (Less)
Please use this url to cite or link to this publication:
https://lup.lub.lu.se/record/9a2c6f3a-5040-4b12-9b9e-a558ffe1d3e5
- author
- Cornefjord, Måns
LU
; Bluhme, Joel ; Jakobsson, Andreas LU
; Klintö, Kristina LU
; Lohmander, Anette ; Mamedov, Tofig LU ; Stiernman, Mia LU ; Svensson, Rebecca and Becker, Magnus LU
- organization
-
- Surgery (research group)
- LU Profile Area: Natural and Artificial Cognition
- LTH Profile Area: AI and Digitalization
- LTH Profile Area: Engineering Health
- eSSENCE: The e-Science Collaboration
- Mathematical Statistics
- Biomedical Modelling and Computation (research group)
- Statistical Signal Processing Group (research group)
- Logopedics, Phoniatrics and Audiology
- EpiHealth: Epidemiology for Health
- publishing date
- 2024
- type
- Contribution to journal
- publication status
- epub
- subject
- in
- Cleft Palate - Craniofacial Journal
- publisher
- SAGE Publications
- ISSN
- 1545-1569
- DOI
- 10.1177/1055665624127164
- language
- English
- LU publication?
- yes
- id
- 9a2c6f3a-5040-4b12-9b9e-a558ffe1d3e5
- date added to LUP
- 2024-08-19 15:46:55
- date last changed
- 2024-08-19 16:08:33
@article{9a2c6f3a-5040-4b12-9b9e-a558ffe1d3e5, abstract = {{Objective<br/>Development of an AI tool to assess velopharyngeal competence (VPC) in children with cleft palate, with/without cleft lip.<br/>Design<br/>Innovation of an AI tool using retrospective audio recordings and assessments of VPC.<br/>Setting<br/>Two datasets were used. The first, named the SR dataset, included data from follow-up visits to Skåne University Hospital, Sweden. The second, named the SC + IC dataset, was a combined dataset (SC + IC dataset) with data from the Scandcleft randomized trials across five countries and an intercenter study performed at six Swedish CL/P centers.<br/>Participants<br/>SR dataset included 153 recordings from 162 children, and SC + IC dataset included 308 recordings from 399 children. All recordings were from ages 5 or 10, with corresponding VPC assessments.<br/>Interventions<br/>Development of two networks, a convolutional neural network (CNN) and a pre-trained CNN (VGGish). After initial testing using the SR dataset, the networks were re-tested using the SC + IC dataset and modified to improve performance.<br/>Main Outcome Measures<br/>Accuracy of the networks' VPC scores, with speech and language pathologistś scores seen as the true values. A three-point scale was used for VPC assessments.<br/>Results<br/>VGGish outperformed CNN, achieving 57.1% accuracy compared to 39.8%. Minor adjustments in data pre-processing and network characteristics improved accuracies.<br/>Conclusions<br/>Network accuracies were too low for the networks to be useful alternatives for VPC assessment in clinical practice. Suggestions for future research with regards to study design and dataset optimization were discussed.}}, author = {{Cornefjord, Måns and Bluhme, Joel and Jakobsson, Andreas and Klintö, Kristina and Lohmander, Anette and Mamedov, Tofig and Stiernman, Mia and Svensson, Rebecca and Becker, Magnus}}, issn = {{1545-1569}}, language = {{eng}}, publisher = {{SAGE Publications}}, series = {{Cleft Palate - Craniofacial Journal}}, title = {{Using Artificial Intelligence for Assessment of Velopharyngeal Competence in Children Born With Cleft Palate With or Without Cleft Lip}}, url = {{http://dx.doi.org/10.1177/1055665624127164}}, doi = {{10.1177/1055665624127164}}, year = {{2024}}, }