title: Validity of faculty and resident global assessment of medical students' clinical knowledge during their pediatrics clerkship.
abstract: OBJECTIVE
  Medical knowledge is one of six core competencies in medicine. Medical student assessments should be valid and reliable. We assessed the relationship between faculty and resident global assessment of pediatric medical student knowledge and performance on a standardized test in medical knowledge.
  
  
  METHODS
  Retrospective cross-sectional study of medical students on a pediatric clerkship in academic year 2008-2009 at one academic health center. Faculty and residents rated students' clinical knowledge on a 5-point Likert scale. The inter-rater reliability of clinical knowledge ratings was assessed by calculating the intra-class correlation coefficient (ICC) for residents' ratings, faculty ratings, and both rating types combined. Convergent validity between clinical knowledge ratings and scores on the National Board of Medical Examiners (NBME) clinical subject examination in pediatrics was assessed with Pearson product moment correlation correction and the coefficient of the determination.
  
  
  RESULTS
  There was moderate agreement for global clinical knowledge ratings by faculty and moderate agreement for ratings by residents. The agreement was also moderate when faculty and resident ratings were combined. Global ratings of clinical knowledge had high convergent validity with pediatric examination scores when students were rated by both residents and faculty.
  
  
  CONCLUSIONS
  Our findings provide evidence for convergent validity of global assessment of medical students' clinical knowledge with NBME subject examination scores in pediatrics.
authors: Department of Pediatrics, Johns Hopkins University School of Medicine, Baltimore, MD, USA. rdudas@jhmi.edu
authors: Robert A
authors: RA
authors: Dudas
authors: Jorie M
authors: JM
authors: Colbert
authors: Seth
authors: S
authors: Goldstein
authors: Michael A
authors: MA
authors: Barone
mesh_terms: D002982:Clinical Clerkship; D002983:Clinical Competence; D004521:Educational Measurement; D005180:Faculty, Medical; D006801:Humans; D007396:Internship and Residency; D010372:Pediatrics / Q000193:education*; D015203:Reproducibility of Results; D013337:Students, Medical