title: Initial Validity Analysis of the American Board of Emergency Medicine Enhanced Oral Examination.
abstract: The American Board of Emergency Medicine (ABEM) has introduced a new testing format for the oral certification examination (OCE): the enhanced oral or "eOral" format. The purpose of this study was to perform initial validity analyses of the eOral format. The two hypotheses were: 1) the case content in the eOral format was sufficiently similar to clinical practice and 2) the eOral case materials were sufficiently similar to clinical practice. The eOral and traditional formats were compared for these characteristics.
  
  
  
  This was a prospective survey study. The survey was administered as a voluntary postexamination activity at the end of the 2015 spring (April 25-27) and fall (October 10-13) ABEM OCEs. The survey is a routine part of the ABEM oral examination experience. For 2015, two additional questions were added to gauge the similarity of the eOral format to clinical practice. Validity was defined by content and substantive elements within Messick's model of construct validity as well as portions of Kane's validity model.
  
  
  
  Of the 1,746 physicians who took the oral examination, 1,380 physicians (79.0%) completed all or part of the study survey questions. The majority of respondents agreed the patient presentations in the cases were similar (strongly agreed or agreed) to cases seen in clinical practice, in both the traditional cases (95.1%) and the eOral cases (90.1%). Likewise, the majority of respondents answered that the case materials (e.g., laboratory, radiographs) were similar (strongly agreed or agreed) to what they encounter in clinical practice, both in the traditional format (85.8%) and in the eOral cases (93.7%).
  
  
  
  Most emergency physicians reported that the types of cases tested in the traditional and eOral formats were similar to cases encountered in clinical practice. In addition, most physicians found the case materials to be similar to what is seen in clinical practice. This study provides early validity evidence for the eOral format.
authors: Department of Emergency Medicine, William Beaumont Health System, Royal Oak, MI.|Department of Emergency Medicine, Oakland University William Beaumont School of Medicine, Royal Oak, MI.
authors: Terry
authors: T
authors: Kowalenko
authors: Department of Emergency Medicine, St. Mary Medical Center, Long Beach, CA.
authors: Barry N
authors: BN
authors: Heller
authors: Department of Emergency Medicine, The Christ Hospital, Cincinnati, OH.
authors: Robert W
authors: RW
authors: Strauss
authors: Department of Emergency Medicine, Eastern Virginia Medical School, Norfolk, VA.
authors: Francis L
authors: FL
authors: Counselman
authors: Department of Emergency Medicine, University of Louisville School of Medicine, Louisville, KY.
authors: Mary Nan S
authors: MN
authors: Mallory
authors: American Board of Emergency Medicine, East Lansing, MI.
authors: Kevin B
authors: KB
authors: Joldersma
authors: American Board of Emergency Medicine, East Lansing, MI.
authors: Andrea B
authors: AB
authors: Coombs
authors: American Board of Emergency Medicine, East Lansing, MI.
authors: Anne L
authors: AL
authors: Harvey
authors: American Board of Emergency Medicine, East Lansing, MI.
authors: Earl J
authors: EJ
authors: Reisdorff
mesh_terms: D002568:Certification / Q000592:standards*; D003945:Diagnosis, Oral / Q000592:standards*; D004635:Emergency Medicine / Q000193:education*; D006801:Humans; D011446:Prospective Studies; D011795:Surveys and Questionnaires; D014481:United States