Skip to main content

Lund University Publications

LUND UNIVERSITY LIBRARIES

Assessment of EVAR Competence : Validity of a Novel Rating Scale (EVARATE) in a Simulated Setting

Strøm, Michael ; Lönn, Lars ; Konge, Lars ; Schroeder, Torben V. ; Lindgren, Hans LU ; Nyheim, Thomas ; Venermo, Maarit and Bech, Bo (2018) In European Journal of Vascular and Endovascular Surgery 56(1). p.137-144
Abstract

Objectives: The aims of this study were to investigate the validity evidence for a novel procedure specific assessment tool of competence in endovascular aortic repair (EVAR) and to establish a pass/fail level for the assessment. Methods: Computed tomography angiography data of a 55 mm in diameter infrarenal aortic aneurysm was implemented into an endovascular simulator. Twenty-three physicians with varying EVAR experiences were video-recorded when performing a standard EVAR procedure on the simulator. Two experienced EVAR operators assessed the participants using the novel rating scale, “EndoVascular Aortic Repair Assessment of Technical Expertise” (EVARATE). Validity was studied according to the framework endorsed by the American... (More)

Objectives: The aims of this study were to investigate the validity evidence for a novel procedure specific assessment tool of competence in endovascular aortic repair (EVAR) and to establish a pass/fail level for the assessment. Methods: Computed tomography angiography data of a 55 mm in diameter infrarenal aortic aneurysm was implemented into an endovascular simulator. Twenty-three physicians with varying EVAR experiences were video-recorded when performing a standard EVAR procedure on the simulator. Two experienced EVAR operators assessed the participants using the novel rating scale, “EndoVascular Aortic Repair Assessment of Technical Expertise” (EVARATE). Validity was studied according to the framework endorsed by the American Educational Research Association. Results: The EVARATE scale had a high internal consistency (Cronbach's alpha =.90). The inter-rater reliability was acceptable (Intraclass Correlation Coefficient =.68, p =.005). Specific EVAR experience correlated significantly with the EVARATE score (Spearman's rho =.62, p =.002), but general endovascular experience did not. Consequence analysis showed that the EVARATE assessment could distinguish novices from intermediates (p <.01) and from experts (p <.001). A pass/fail score was determined using the contrasting groups’ method. Conclusion: This paper presents the initial validity evidence for a novel procedure specific assessment tool, EVARATE, for operator competence in endovascular aortic repair investigated in a simulated setting. The assessment tool can be used to provide structured formative feedback to trainees.

(Less)
Please use this url to cite or link to this publication:
author
; ; ; ; ; ; and
organization
publishing date
type
Contribution to journal
publication status
published
subject
keywords
Abdominal aortic aneurysm, Educational assessment, Endovascular, EVAR, Simulation, Training
in
European Journal of Vascular and Endovascular Surgery
volume
56
issue
1
pages
137 - 144
publisher
Elsevier
external identifiers
  • pmid:29628288
  • scopus:85044953873
ISSN
1078-5884
DOI
10.1016/j.ejvs.2018.02.035
language
English
LU publication?
yes
id
613ffec1-97b6-447a-927b-e0f35ac2c9c4
date added to LUP
2018-04-17 09:57:23
date last changed
2024-01-29 14:44:00
@article{613ffec1-97b6-447a-927b-e0f35ac2c9c4,
  abstract     = {{<p>Objectives: The aims of this study were to investigate the validity evidence for a novel procedure specific assessment tool of competence in endovascular aortic repair (EVAR) and to establish a pass/fail level for the assessment. Methods: Computed tomography angiography data of a 55 mm in diameter infrarenal aortic aneurysm was implemented into an endovascular simulator. Twenty-three physicians with varying EVAR experiences were video-recorded when performing a standard EVAR procedure on the simulator. Two experienced EVAR operators assessed the participants using the novel rating scale, “EndoVascular Aortic Repair Assessment of Technical Expertise” (EVARATE). Validity was studied according to the framework endorsed by the American Educational Research Association. Results: The EVARATE scale had a high internal consistency (Cronbach's alpha =.90). The inter-rater reliability was acceptable (Intraclass Correlation Coefficient =.68, p =.005). Specific EVAR experience correlated significantly with the EVARATE score (Spearman's rho =.62, p =.002), but general endovascular experience did not. Consequence analysis showed that the EVARATE assessment could distinguish novices from intermediates (p &lt;.01) and from experts (p &lt;.001). A pass/fail score was determined using the contrasting groups’ method. Conclusion: This paper presents the initial validity evidence for a novel procedure specific assessment tool, EVARATE, for operator competence in endovascular aortic repair investigated in a simulated setting. The assessment tool can be used to provide structured formative feedback to trainees.</p>}},
  author       = {{Strøm, Michael and Lönn, Lars and Konge, Lars and Schroeder, Torben V. and Lindgren, Hans and Nyheim, Thomas and Venermo, Maarit and Bech, Bo}},
  issn         = {{1078-5884}},
  keywords     = {{Abdominal aortic aneurysm; Educational assessment; Endovascular; EVAR; Simulation; Training}},
  language     = {{eng}},
  month        = {{04}},
  number       = {{1}},
  pages        = {{137--144}},
  publisher    = {{Elsevier}},
  series       = {{European Journal of Vascular and Endovascular Surgery}},
  title        = {{Assessment of EVAR Competence : Validity of a Novel Rating Scale (EVARATE) in a Simulated Setting}},
  url          = {{http://dx.doi.org/10.1016/j.ejvs.2018.02.035}},
  doi          = {{10.1016/j.ejvs.2018.02.035}},
  volume       = {{56}},
  year         = {{2018}},
}