Assessment of validity of an OSATS for cystoscopic and ureteroscopic cognitive and psychomotor skills.
OBJECTIVE
The purpose of the study was to assess the construct validity of an Objective Structured Assessment of Technical Skills (OSATS) developed for cystoscopic and ureteroscopic cognitive and psychomotor skills.


METHODS
An OSATS was designed based on a 14-point comprehensive curriculum prepared by two experts that targeted both cognitive and psychomotor cystoscopic and ureteroscopic skills. Ten urology residents from a single institution with different levels of training were assessed on a series of stations that targeted these skills. Evaluation of cognitive skills was done via a written examination, and psychomotor skills assessment was done by experts using both subjective and objective metrics.


RESULTS
Twelve of 15 cognitive tasks and 5 of 5 psychomotor tasks demonstrated construct validity with correlation coefficient (r) more than .75. All three of the cognitive tasks that failed to initially demonstrate validity did so on editorial revision and restructuring of the questions.


CONCLUSIONS
Our cystoscopic and ureteroscopic OSATS showed excellent construct validity for our population of residents, and we have incorporated it into our urologic skills curriculum.
Kishore
Thekke Adiyat
TA
Department of Urologic Surgery, University of Minnesota, Minneapolis, Minnesota 55455-0392, USA.
Pedro
Renato N
RN
Monga
Manoj
M
Sweet
Robert M
RM
D003071:Cognition; D003479:Curriculum; D003558:Cystoscopy; D004521:Educational Measurement; D006801:Humans; D009048:Motor Skills; D015203:Reproducibility of Results; D018666:Ureteroscopy