title: Assessment of subjective workload in an anaesthesia simulator environment: reliability and validity.
abstract: OBJECTIVE
  For the subjective assessment of workload, Borg's Rating of Perceived Exertion (RPE) scale is a global measure of perceived workload during anaesthesia induction, maintenance and emergence in the real workplace. In the present study, validity and reliability of the RPE scale were analysed for a full-scale simulator environment using scenarios of induction of general anaesthesia with and without critical incidents.
  
  
  METHODS
  Seventeen anaesthetists (professional experience 1-30 years) participated in this randomised cross-over trial. Each participant rated their workload using the RPE scale after three different simulator sessions. No critical incident was simulated in the 1st session. In a randomised order, workload was increased by simulation of a critical incident in the 2nd or 3rd session. For the analysis of validity and reliability, univariate and multivariate regression analysis and the concordance correlation coefficient were used.
  
  
  RESULTS
  RPE scores were significantly increased after managing a simulated critical incident [13.0, 95% confidence interval (CI) 11.6-14.5] compared to normal anaesthesia induction (9.4, 95% CI 8.2-10.6; P < 0.001). Reliability was moderate (concordance correlation coefficient = 0.55; 95% CI 0.13-0.80) for uneventful sessions.
  
  
  CONCLUSIONS
  RPE scores were significantly increased after critical incidents during simulated anaesthesia induction and indicate good construct validity. Reliability may be impaired by the fact that the first session was announced to be without a critical incident. The RPE scale is easy to administer and a valid tool for subjective workload assessment in simulator settings. Reliability is moderate.
authors.affiliation: Department of Anaesthesiology, Technische Universität München, Munich, Germany. c.m.schulz@lrz.tum.de
authors.forename: Christian M
authors.initials: CM
authors.lastname: Schulz
authors.forename: Matthias
authors.initials: M
authors.lastname: Skrzypczak
authors.forename: Erich
authors.initials: E
authors.lastname: Schneider
authors.forename: Alexander
authors.initials: A
authors.lastname: Hapfelmeier
authors.forename: Jan
authors.initials: J
authors.lastname: Martin
authors.forename: Eberhard F
authors.initials: EF
authors.lastname: Kochs
authors.forename: Gerhard
authors.initials: G
authors.lastname: Schneider
mesh_terms: D000707:Anaphylaxis / Q000628:therapy*; D000768:Anesthesia, General; D000776:Anesthesiology; D001288:Attention; D001291:Attitude of Health Personnel; D003198:Computer Simulation; D003422:Critical Care; D018592:Cross-Over Studies; D005133:Eye Movements; D005260:Female; D006339:Heart Rate; D006801:Humans; D008297:Male; D008348:Manikins; D010465:Perception; D005082:Physical Exertion; D011680:Pupil / Q000502:physiology; D012044:Regression Analysis; D015203:Reproducibility of Results; D011795:Surveys and Questionnaires; D013647:Task Performance and Analysis; D000078329:Workforce; D016526:Workload