title: Assessing the reliability and validity of a residency selection process examination: a preliminary study between the national board of medical examiners and the University of Panama Faculty of Medicine.
abstract: BACKGROUND
  The Ministry of Health of the Republic of Panama is currently developing a national examination system that will be used to license graduates to practice medicine in that country, as well as to undertake postgraduate medical training. As part of these efforts, a preliminary project was undertaken between the National Board of Medical Examiners (NBME) and the Faculty of Medicine of the University of Panama to develop a Residency Selection Process Examination (RSPE).
  
  
  OBJECTIVE
  The purpose of this study was to assess the reliability and validity of RSPE scores for a sample of candidates who wished to obtain a residency slot in Panama.
  
  
  METHODS
  The RSPE, composed of 200 basic and clinical sciences multiple-choice items, was administered to 261 residency applicants at the University of Panama.
  
  
  RESULTS
  The reliability estimate computed was comparable with that reported with other high-stakes examinations (Cronbach's alpha = 0.89). Also, a Rasch examinee proficiency item difficulty plot showed that the RSPE was well targeted to the proficiency levels of candidates. Finally, a moderate correlation was noted between local grade point averages and RSPE scores for University of Panama students (r = 0.38).
  
  
  CONCLUSIONS
  Findings suggest that it is possible to translate and adapt test materials for use in other contexts.
authors.affiliation: National Board Of Medical Examiners, 3750 Market Street, Philadelphia, PA 19104, USA. adechamplain@nbme.org
authors.forename: André F
authors.initials: AF
authors.lastname: De Champlain
authors.forename: Peter
authors.initials: P
authors.lastname: Scoles
authors.forename: Kathy
authors.initials: K
authors.lastname: Holtzman
authors.forename: Kathy
authors.initials: K
authors.lastname: Angelucci
authors.forename: Maria C
authors.initials: MC
authors.lastname: Flores
authors.forename: Enrique
authors.initials: E
authors.lastname: Mendoza
authors.forename: Marion
authors.initials: M
authors.lastname: Martin
authors.forename: Oriz Lam
authors.initials: OL
authors.lastname: De Calvo
mesh_terms: D007396:Internship and Residency; D008004:Licensure; D010176:Panama; D012570:School Admission Criteria; D012577:Schools, Medical / Q000458:organization & administration*