Advanced

Confirmatory factor analysis of the Evidence-Based Practice Attitude Scale in a large and representative sample of child and adolescent mental health practitioners: Is the use of a total scale score justified?

Santesson, Anna LU ; Bäckström, Martin LU ; Holmberg, Robert LU ; Perrin, Sean LU and Jarbin, Håkan LU (2020) In BMC Medical Research Methodology
Abstract
Background: There is a call for valid and reliable instruments to evaluate implementation of evidence-based practices (EBP). The 15-item Evidence-Based Practice Attitude Scale (EBPAS) measures attitude toward EBP, incorporating four lower-order factor subscales (Appeal, Requirements, Openness, and Divergence) and a Total scale (General Attitudes). It is one of a few measures of EBP attitudes evaluated for its psychometric properties. The reliability of the Total scale has been repeatedly supported, but also the multidimensionality of the inventory. However, whether all of the items contribute to the EBPAS Total beyond their subscales has yet to be demonstrated. In addition, the validity of the Divergence subscale has been questioned... (More)
Background: There is a call for valid and reliable instruments to evaluate implementation of evidence-based practices (EBP). The 15-item Evidence-Based Practice Attitude Scale (EBPAS) measures attitude toward EBP, incorporating four lower-order factor subscales (Appeal, Requirements, Openness, and Divergence) and a Total scale (General Attitudes). It is one of a few measures of EBP attitudes evaluated for its psychometric properties. The reliability of the Total scale has been repeatedly supported, but also the multidimensionality of the inventory. However, whether all of the items contribute to the EBPAS Total beyond their subscales has yet to be demonstrated. In addition, the validity of the Divergence subscale has been questioned because of its low correlation with the other subscales and low inter-item correlations. The EBPAS is widely used to tailor and evaluate implementation efforts but a Swedish version has not yet been validated. This study aimed to contribute to the development and cross-validation of the EBPAS by examining the factor structure of a Swedish-language version in a large sample of mental health professionals. Methods: The EBPAS was translated into Swedish and completed by 570 mental health professionals working in child and adolescent psychiatry settings spread across Sweden. The factor structure was examined using first-order, second-order and bifactor confirmatory factor analytic (CFA) models. Results: Adequate fit indices were observed for all CFA models with strong support for the reliability of the EBPAS Total score in this Swedish version. Support for the hierarchical second-order model was also strong, while the bifactor model gave mixed support for the subscales. The Openness and Requirements subscales came out best, while there were problems with both the Appeal (e.g. not different from the General Attitudes factor) and the Divergence subscales (e.g. low reliability). Conclusions: Overall, the psychometric properties were on par with the English version and the total score appears to be a valid measure of general attitudes towards EBP. This is the first study supporting this General Attitudes factor based on a bifactor model. Although comparatively better supported in this Swedish sample, we conclude that the use of the EBPAS subscale scores may result in misleading conclusions. Practical implications and future directions are discussed. (Less)
Please use this url to cite or link to this publication:
author
; ; ; and
organization
publishing date
type
Contribution to journal
publication status
published
subject
keywords
Evidence Based Practice, child and adolescent psychiatry, major depression, treatment implementation, Assessment
in
BMC Medical Research Methodology
article number
254
publisher
BioMed Central (BMC)
external identifiers
  • scopus:85092649298
  • pmid:33054717
ISSN
1471-2288
DOI
10.1186/s12874-020-01126-4
language
English
LU publication?
yes
id
b10d7e31-270e-4a1f-8927-ed05ec4d9382
date added to LUP
2020-09-18 08:30:27
date last changed
2020-11-05 03:00:02
@article{b10d7e31-270e-4a1f-8927-ed05ec4d9382,
  abstract     = {Background: There is a call for valid and reliable instruments to evaluate implementation of evidence-based practices (EBP). The 15-item Evidence-Based Practice Attitude Scale (EBPAS) measures attitude toward EBP, incorporating four lower-order factor subscales (Appeal, Requirements, Openness, and Divergence) and a Total scale (General Attitudes). It is one of a few measures of EBP attitudes evaluated for its psychometric properties. The reliability of the Total scale has been repeatedly supported, but also the multidimensionality of the inventory. However, whether all of the items contribute to the EBPAS Total beyond their subscales has yet to be demonstrated. In addition, the validity of the Divergence subscale has been questioned because of its low correlation with the other subscales and low inter-item correlations. The EBPAS is widely used to tailor and evaluate implementation efforts but a Swedish version has not yet been validated. This study aimed to contribute to the development and cross-validation of the EBPAS by examining the factor structure of a Swedish-language version in a large sample of mental health professionals. Methods: The EBPAS was translated into Swedish and completed by 570 mental health professionals working in child and adolescent psychiatry settings spread across Sweden. The factor structure was examined using first-order, second-order and bifactor confirmatory factor analytic (CFA) models. Results: Adequate fit indices were observed for all CFA models with strong support for the reliability of the EBPAS Total score in this Swedish version. Support for the hierarchical second-order model was also strong, while the bifactor model gave mixed support for the subscales. The Openness and Requirements subscales came out best, while there were problems with both the Appeal (e.g. not different from the General Attitudes factor) and the Divergence subscales (e.g. low reliability). Conclusions: Overall, the psychometric properties were on par with the English version and the total score appears to be a valid measure of general attitudes towards EBP. This is the first study supporting this General Attitudes factor based on a bifactor model. Although comparatively better supported in this Swedish sample, we conclude that the use of the EBPAS subscale scores may result in misleading conclusions. Practical implications and future directions are discussed.},
  author       = {Santesson, Anna and Bäckström, Martin and Holmberg, Robert and Perrin, Sean and Jarbin, Håkan},
  issn         = {1471-2288},
  language     = {eng},
  publisher    = {BioMed Central (BMC)},
  series       = {BMC Medical Research Methodology},
  title        = {Confirmatory factor analysis of the Evidence-Based Practice Attitude Scale in a large and representative sample of child and adolescent mental health practitioners: Is the use of a total scale score justified?},
  url          = {http://dx.doi.org/10.1186/s12874-020-01126-4},
  doi          = {10.1186/s12874-020-01126-4},
  year         = {2020},
}