Assessing endovascular skills using the Simulator for Testing and Rating Endovascular Skills (STRESS) machine.
OBJECTIVE
Endovascular techniques are an integral part of modern-day vascular surgery practice and training. Nevertheless, validated in vitro assessment tools for these skills are scarce. This study describes the development and pilot testing of the Simulator for Testing and Rating Endovascular Skills (STRESS machine).


METHODS
The design was kept straightforward and compact, without the need for contrast or fluoroscopy. A specific technical skill score was designed analogous to the Imperial College Evaluation of Procedural Skill (ICEPS), an assessment score for open surgical skill. This score was combined with an already validated global rating assessment to form the total score (TS).


METHODS
A pilot study was carried out on 18 candidates of varying levels of expertise: novice, intermediate and expert, who were assessed by two independent observers to test inter-observer reliability.


RESULTS
Inter-observer reliability was excellent, Cronbach's alpha coefficient of the TS was 0.94 (95% confidence interval: 0.84-0.97). A one-way analysis of variance (ANOVA) showed a significant difference between the novice and expert groups (p<0.001), between the novice and intermediate groups (p<0.01) and between the intermediate and expert groups (p<0.05).


CONCLUSIONS
The STRESS machine, in combination with the specific technical skill score and global rating assessment, provides a reliable method of discriminating between the novice, intermediate and expert candidates with excellent inter-observer variability.
Willems
M C M
MC
Department of Vascular Surgery, Radboud University Nijmegen Medical Centre, PO Box 9101, 6500 HB Nijmegen, The Netherlands. m.willems@chir.umcn.nl
van der Vliet
J Adam
JA
Williams
V
V
Kool
L J Schultze
LJ
Bergqvist
D
D
Blankensteijn
J D
JD
D002404:Catheterization; D002983:Clinical Competence; D003198:Computer Simulation; D006801:Humans; D010865:Pilot Projects; D012078:Renal Artery Obstruction / Q000628:therapy*; D015203:Reproducibility of Results; D013997:Time Factors