title: Development and initial validation of a program director's evaluation form for medical school graduates.
abstract: BACKGROUND
  In the early 1990 s, our group of interdepartmental academicians at the Uniformed Services University (USU) developed a PGY-1 (postgraduate year 1) program director evaluation form. Recently, we have revised it to better align with the core competencies established by the Accreditation Council for Graduate Medical Education. We also included items that reflected USU's military-unique context.
  
  
  OBJECTIVE
  To collect feasibility, reliability, and validity evidence for our revised survey.
  
  
  METHODS
  We collected PGY-1 data from program directors (PD) who oversee the training of military medical trainees. The cohort of the present study consisted of USU students graduating in 2010 and 2011. We performed exploratory factor analysis (EFA) to examine the factorial validity of the survey scores and subjected each of the factors identified in the EFA to an internal consistency reliability analysis. We then performed correlation analysis to examine the relationship between PD ratings and students' medical school grade point averages (GPAs) and performance on U.S. Medical Licensing Examinations Step assessments.
  
  
  RESULTS
  Five factors emerged from the EFA--Medical Expertise, Military-unique Practice, Professionalism, System-based Practice, and Communication and Interpersonal Skills." The evaluation form also showed good reliability and feasibility. All five factors were more strongly associated with students' GPA in the initial clerkship year than the first 2 years. Further, these factors showed stronger correlations with students' performance on Step 3 than other Step Examinations.
  
  
  CONCLUSIONS
  The revised PD evaluation form seemed to be a valid and reliable tool to gauge medical graduates' first-year internship performance.
authors: Department of Medicine, Uniformed Services University of the Health Sciences, 4301 Jones Bridge Road, Bethesda, MD 20814.
authors: Ting
authors: T
authors: Dong
authors: Department of Medicine, Uniformed Services University of the Health Sciences, 4301 Jones Bridge Road, Bethesda, MD 20814.
authors: Steven J
authors: SJ
authors: Durning
authors: F. Edward Hebert School of Medicine, Uniformed Services University of the Health Sciences, 4301 Jones Bridge Road, Bethesda, MD 20814.
authors: William R
authors: WR
authors: Gilliland
authors: National Board of Medical Examiners, 3750 Market Street, Philadelphia, PA 19104.
authors: Kimberly A
authors: KA
authors: Swygert
authors: Department of Medicine, Uniformed Services University of the Health Sciences, 4301 Jones Bridge Road, Bethesda, MD 20814.
authors: Anthony R
authors: AR
authors: Artino
mesh_terms: D000328:Adult; D002983:Clinical Competence; D004503:Education, Medical, Graduate / Q000379:methods / Q000592:standards*; D004521:Educational Measurement / Q000379:methods*; D005163:Factor Analysis, Statistical; D005180:Faculty, Medical; D005240:Feasibility Studies; D005260:Female; D006801:Humans; D008297:Male; D015203:Reproducibility of Results; D012577:Schools, Medical; D013337:Students, Medical / Q000706:statistics & numerical data*; D011795:Surveys and Questionnaires / Q000592:standards*; D014481:United States