title: Computer-assessed performance of psychomotor skills in endoscopic otolaryngology surgery: construct validity of the Dundee Endoscopic Psychomotor Otolaryngology Surgery Trainer (DEPOST).
abstract: BACKGROUND
  This study was undertaken to introduce and establish the value of the Dundee Endoscopic Psychomotor Otolaryngology Surgery Trainer (DEPOST) as a customisable, objective real-time scoring system for trainee assessment. The construct validity of the system was assessed by comparing the performance of experienced otolaryngologists with that of otolaryngology trainees, junior doctors and medical students.
  
  
  METHODS
  Forty two subjects (13 Consultants, 8 senior trainees, 13 junior trainees and 8 junior doctors/medical students) completed a single test on DEPOST. The test involved using a 30° rigid endoscope and a probe with position sensor, to identify a series of lights in a complex 3-dimensional model. The system scored subjects for time, success rate, and economy of movement (distance travelled). An analysis of variance and correlation analysis were used for the data analysis, with statistical significance set at 0.05.
  
  
  RESULTS
  Increasing experience led to significantly improved performance with the DEPOST (p < 0.01). Senior trainees' results were significantly better than those of consultant otolaryngologists in success rate and time (p < 0.05 & p < 0.05). Consultants were the most efficient in their movement (p = 0.051) CONCLUSIONS: The system provides an accurate and customisable assessment of endoscopic skill in otolaryngologists. The DEPOST system has construct validity, with master surgeons and senior trainees completing the tasks more accurately without sacrificing execution time, success rate or efficiency of movement.
authors.affiliation: Department of Otolaryngology, Ninewells Hospital and Medical School, University of Dundee, Dundee, DD1 9SY, Scotland, UK. p.x.ross@dundee.ac.uk.
authors.forename: Peter D
authors.initials: PD
authors.lastname: Ross
authors.affiliation: Department of Otolaryngology, Ninewells Hospital and Medical School, University of Dundee, Dundee, DD1 9SY, Scotland, UK.
authors.forename: Richard
authors.initials: R
authors.lastname: Steven
authors.affiliation: School of Engineering, University of Dundee, Dundee, DD1 4HN, Scotland, UK.
authors.forename: Dong
authors.initials: D
authors.lastname: Zhang
authors.affiliation: School of Engineering, University of Dundee, Dundee, DD1 4HN, Scotland, UK.
authors.forename: Heng
authors.initials: H
authors.lastname: Li
authors.affiliation: School of Engineering, University of Dundee, Dundee, DD1 4HN, Scotland, UK.
authors.forename: Eric W
authors.initials: EW
authors.lastname: Abel
mesh_terms: D000328:Adult; D002983:Clinical Competence; D004724:Endoscopy / Q000193:education*; D005180:Faculty, Medical / Q000592:standards*; D005260:Female; D006801:Humans; D008297:Male; D008875:Middle Aged; D010036:Otolaryngology / Q000193:education*; D011597:Psychomotor Performance; D013337:Students, Medical / Q000523:psychology*; D025321:Surgery, Computer-Assisted / Q000193:education*; D055815:Young Adult
keywords: Aptitude; Clinical competence; Motor skills; Otolaryngology; Psychomotor performance; Training/courses