Skip to main content

Lund University Publications

LUND UNIVERSITY LIBRARIES

Reliability of Variables of Consonant Production and Velopharyngeal Competence in 10-year-olds with Cleft Palate Using Multiple Raters

Klintö, Kristina LU orcid ; Schaar Johansson, Malin LU orcid ; Andersson, Magdalena ; Gällstedt, Caroline ; Lindberg, Cecilia ; Nelli, Cecilia and Okhiria, Åsa (2024) In Cleft Palate Craniofacial Journal
Abstract

Objective: To assess the reliability of speech data and speech-related quality indicators in the Swedish quality registry for cleft lip and palate (CLP) at 10 years of age. Design: Retrospective study. Setting: University hospitals. Participants: One hundred twenty-one 10-year-olds with unilateral or bilateral CLP. Main outcome measures: Six independent raters reassessed audio recordings for comparison with registry data. For calculation of agreement, the single measures intraclass correlation coefficient (ICC) was used for percentage of consonants correct (PCC) and non-oral speech errors, quadratic weighted kappa for velopharyngeal competence (VPC), and percentage agreement and kappa for quality indicators. The results of the three to... (More)

Objective: To assess the reliability of speech data and speech-related quality indicators in the Swedish quality registry for cleft lip and palate (CLP) at 10 years of age. Design: Retrospective study. Setting: University hospitals. Participants: One hundred twenty-one 10-year-olds with unilateral or bilateral CLP. Main outcome measures: Six independent raters reassessed audio recordings for comparison with registry data. For calculation of agreement, the single measures intraclass correlation coefficient (ICC) was used for percentage of consonants correct (PCC) and non-oral speech errors, quadratic weighted kappa for velopharyngeal competence (VPC), and percentage agreement and kappa for quality indicators. The results of the three to four raters with the highest intra-rater and inter-rater reliability were used for comparison with registry data. Results: There was excellent agreement between registry data and reassessments for PCC (ICC, 0.93) and percentage of non-oral errors (ICC, 0.80). For VPC, one rater and registry data had good agreement (k, 0.704); the remaining cases had fair agreement (k, 0.476-0.554). The percentage agreement between registry data and reassessments for quality indicators ranged from fair to excellent. When calculated with kappa, agreement was good to excellent (mean of all k values, 0.67-0.70). Conclusions: The CLP registry variables PCC and percentage of non-oral errors and the quality indicators without non-oral speech errors and competent/marginally incompetent velopharyngeal function are reliable for use in clinical audits and research of 10-year-olds. The three-tier ratings of VPC have weaker reliability but can still be useful in more detailed analyses if interpreted with caution.

(Less)
Please use this url to cite or link to this publication:
author
; ; ; ; ; and
organization
publishing date
type
Contribution to journal
publication status
in press
subject
keywords
cleft lip and palate, quality indicators, quality registry, reliability, speech variables
in
Cleft Palate Craniofacial Journal
publisher
SAGE Publications
external identifiers
  • pmid:39359238
  • scopus:85205733195
ISSN
1055-6656
DOI
10.1177/10556656241287761
language
English
LU publication?
yes
id
14311273-997b-49b2-9d58-8a1a66139d2c
date added to LUP
2025-01-02 12:57:43
date last changed
2025-07-18 05:44:54
@article{14311273-997b-49b2-9d58-8a1a66139d2c,
  abstract     = {{<p>Objective: To assess the reliability of speech data and speech-related quality indicators in the Swedish quality registry for cleft lip and palate (CLP) at 10 years of age. Design: Retrospective study. Setting: University hospitals. Participants: One hundred twenty-one 10-year-olds with unilateral or bilateral CLP. Main outcome measures: Six independent raters reassessed audio recordings for comparison with registry data. For calculation of agreement, the single measures intraclass correlation coefficient (ICC) was used for percentage of consonants correct (PCC) and non-oral speech errors, quadratic weighted kappa for velopharyngeal competence (VPC), and percentage agreement and kappa for quality indicators. The results of the three to four raters with the highest intra-rater and inter-rater reliability were used for comparison with registry data. Results: There was excellent agreement between registry data and reassessments for PCC (ICC, 0.93) and percentage of non-oral errors (ICC, 0.80). For VPC, one rater and registry data had good agreement (k, 0.704); the remaining cases had fair agreement (k, 0.476-0.554). The percentage agreement between registry data and reassessments for quality indicators ranged from fair to excellent. When calculated with kappa, agreement was good to excellent (mean of all k values, 0.67-0.70). Conclusions: The CLP registry variables PCC and percentage of non-oral errors and the quality indicators without non-oral speech errors and competent/marginally incompetent velopharyngeal function are reliable for use in clinical audits and research of 10-year-olds. The three-tier ratings of VPC have weaker reliability but can still be useful in more detailed analyses if interpreted with caution.</p>}},
  author       = {{Klintö, Kristina and Schaar Johansson, Malin and Andersson, Magdalena and Gällstedt, Caroline and Lindberg, Cecilia and Nelli, Cecilia and Okhiria, Åsa}},
  issn         = {{1055-6656}},
  keywords     = {{cleft lip and palate; quality indicators; quality registry; reliability; speech variables}},
  language     = {{eng}},
  publisher    = {{SAGE Publications}},
  series       = {{Cleft Palate Craniofacial Journal}},
  title        = {{Reliability of Variables of Consonant Production and Velopharyngeal Competence in 10-year-olds with Cleft Palate Using Multiple Raters}},
  url          = {{http://dx.doi.org/10.1177/10556656241287761}},
  doi          = {{10.1177/10556656241287761}},
  year         = {{2024}},
}