title: A pilot study of the mental workload of objective structured clinical examination examiners.
abstract: BACKGROUND
  Mental workload is a concept used in many industries to investigate operator performance, but it has only recently been used in the educational setting. It has been suggested that excessive mental workload in assessors may impair the validity of objective structured clinical examination (OSCE)-type assessments.
  
  
  OBJECTIVE
  This study aimed to establish the feasibility of measuring the mental workload of examiners during an OSCE assessment and to establish methodologies and baseline values to guide future study design.
  
  
  METHODS
  Two previously validated methods of measuring mental workload, the NASA-Task Load Index rating scale and use of a secondary task (response to a prompt from a vibrotactile device), were used to measure the workload of 10 subjects during a formative OSCE. Trainee anaesthetists (n = 24) working in an operating theatre were used as a control group.
  
  
  RESULTS
  The mental workload of examiners exceeded that of controls on both measures. Although there was marked inter-subject variability, reliability between stations for individual examiners was robust (α = 0.922).
  
  
  CONCLUSIONS
  These data suggest that mental workload is excessive in OSCE examiners. Further studies are required to measure the effect of changes in assessment design and examiner training.
authors: Institute of Medical Education, School of Medicine, Cardiff University, Cardiff, UK.
authors: Aidan
authors: A
authors: Byrne
authors: Nathan
authors: N
authors: Tweed
authors: Claire
authors: C
authors: Halligan
mesh_terms: D002983:Clinical Competence / Q000592:standards; D004521:Educational Measurement; D006801:Humans; D010865:Pilot Projects; D011930:Reaction Time / Q000502:physiology*; D015203:Reproducibility of Results; D012107:Research Design; D057566:Self Report; D018709:Statistics, Nonparametric; D013647:Task Performance and Analysis; D013663:Teaching; D016526:Workload