title: Validation and piloting of direct observation of practical skills tool to assess intubation in the Chilean context.
abstract: BACKGROUND
  The use of Workplace-Based Assessment (WBA) has increased in recent years.
  
  
  OBJECTIVE
  To create a modified version of Direct Observation of Procedural Skills (DOPS) adapted to the Chilean context and establish its psychometric properties.
  
  
  METHODS
  The content validity of DOPS was established through interviews and consensus survey. To be included in the new version, the respective domain should have been considered by over 80% of interviewers and it should have a Content Validity Index (CVI and kappa statistic over 0.78 and 0.6, respectively. For four months, the new DOPS was used to assess the intubation skills of the anesthesia trainees. Generalizability theory was used to establish reliability and internal consistency.
  
  
  RESULTS
  The interview suggested a DOPS with twelve domains. All were included in the final version as the CVI and kappa values were above 0.9 and 0.8, respectively. 585 procedures were assessed. The G coefficient was 0.90. The intubation needs to be assessed with DOPS at least six times to obtain a G coefficient of 0.80.
  
  
  CONCLUSIONS
  The modified DOPS was a valid, reliable and practical tool for assessing the intubation procedure. Effort needs to be made to improve the staff's feedback skills.
authors: Pontificia Universidad Católica de Chile, Chile. aedelfin@med.puc.cl
authors: Alejandro E
authors: AE
authors: Delfino
authors: Madawa
authors: M
authors: Chandratilake
authors: Fernando R
authors: FR
authors: Altermatt
authors: Ghislaine
authors: G
authors: Echevarria
mesh_terms: D002677:Chile; D002983:Clinical Competence / Q000592:standards*; D004521:Educational Measurement / Q000379:methods; D004947:Esophagus; D006801:Humans; D007440:Intubation / Q000592:standards*; D019370:Observation; D010865:Pilot Projects; D016730:Program Development; D011594:Psychometrics; D036301:Qualitative Research; D011795:Surveys and Questionnaires