title: The impact of postgraduate training on USMLE® step 3® and its computer-based case simulation component.
abstract: BACKGROUND
  The United States Medical Licensing Examination® (USMLE®) Step 3® examination is a computer-based examination composed of multiple choice questions (MCQ) and computer-based case simulations (CCS). The CCS portion of Step 3 is unique in that examinees are exposed to interactive patient-care simulations.
  
  
  OBJECTIVE
  The purpose of the following study is to investigate whether the type and length of examinees' postgraduate training impacts performance on the CCS component of Step 3, consistent with previous research on overall Step 3 performance.
  
  
  METHODS
  Retrospective cohort study
  
  
  METHODS
  Medical school graduates from U.S. and Canadian institutions completing Step 3 for the first time between March 2007 and December 2009 (n = 40,588).
  
  
  METHODS
  Post-graduate training was classified as either broadly focused for general areas of medicine (e.g. pediatrics) or narrowly focused for specific areas of medicine (e.g. radiology). A three-way between-subjects MANOVA was utilized to test for main and interaction effects on Step 3 and CCS scores between the demographic characteristics of the sample and type of residency. Additionally, to examine the impact of postgraduate training, CCS scores were regressed on Step 1 and Step 2 Clinical Knowledge (CK) scores. Residuals from the resulting regressions were plotted.
  
  
  RESULTS
  There was a significant difference in CCS scores between broadly focused (μ = 216, σ = 17) and narrowly focused (μ=211, σ = 16) residencies (p < 0.001). Examinees in broadly focused residencies performed better overall and as length of training increased, compared to examinees in narrowly focused residencies. Predictors of Step 1 and Step 2 CK explained 55% of overall Step 3 variability and 9% of CCS score variability.
  
  
  CONCLUSIONS
  Factors influencing performance on the CCS component may be similar to those affecting Step 3 overall. Findings are supportive of the validity of the Step 3 program and may be useful to program directors and residents in considering readiness to take this examination.
authors: National Board of Medical Examiners, Philadelphia, PA 19104, USA. rfeinberg@nbme.org
authors: Richard A
authors: RA
authors: Feinberg
authors: Kimberly A
authors: KA
authors: Swygert
authors: Steven A
authors: SA
authors: Haist
authors: Gerard F
authors: GF
authors: Dillon
authors: Constance T
authors: CT
authors: Murray
mesh_terms: D002170:Canada; D002983:Clinical Competence / Q000592:standards*; D003658:Decision Making, Computer-Assisted; D004503:Education, Medical, Graduate / Q000379:methods / Q000592:standards*; D004521:Educational Measurement / Q000379:methods / Q000592:standards*; D005260:Female; D006801:Humans; D007396:Internship and Residency / Q000379:methods / Q000592:standards*; D008007:Licensure, Medical / Q000592:standards*; D008297:Male; D012189:Retrospective Studies; D014481:United States