title: Evaluating Validity Evidence for USMLE Step 2 Clinical Skills Data Gathering and Data Interpretation Scores: Does Performance Predict History-Taking and Physical Examination Ratings for First-Year Internal Medicine Residents?
abstract: OBJECTIVE
  To add to the small body of validity research addressing whether scores from performance assessments of clinical skills are related to performance in supervised patient settings, the authors examined relationships between United States Medical Licensing Examination (USMLE) Step 2 Clinical Skills (CS) data gathering and data interpretation scores and subsequent performance in history taking and physical examination in internal medicine residency training.
  
  
  METHODS
  The sample included 6,306 examinees from 238 internal medicine residency programs who completed Step 2 CS for the first time in 2005 and whose performance ratings from their first year of residency training were available. Hierarchical linear modeling techniques were used to examine the relationships among Step 2 CS data gathering and data interpretation scores and history-taking and physical examination ratings.
  
  
  RESULTS
  Step 2 CS data interpretation scores were positively related to both history-taking and physical examination ratings. Step 2 CS data gathering scores were not related to either history-taking or physical examination ratings after other USMLE scores were taken into account.
  
  
  CONCLUSIONS
  Step 2 CS data interpretation scores provide useful information for predicting subsequent performance in history taking and physical examination in supervised practice and thus provide validity evidence for their intended use as an indication of readiness to enter supervised practice. The results show that there is less evidence to support the usefulness of Step 2 CS data gathering scores. This study provides important information for practitioners interested in Step 2 CS specifically or in performance assessments of medical students' clinical skills more generally.
authors.affiliation: M.M. Cuddy is a measurement scientist, National Board of Medical Examiners, Philadelphia, Pennsylvania. M.L. Winward is a measurement scientist, National Board of Medical Examiners, Philadelphia, Pennsylvania. M.M. Johnston is an assessment consultant and a PhD candidate, Center for Assessment and Research Studies, James Madison University, Harrisonburg, Virginia. At the time this research was conducted, M.M.J. was a research associate, American Board of Internal Medicine, Philadelphia, Pennsylvania. R.S. Lipner is senior vice president, Evaluation, Research, and Development, American Board of Internal Medicine, Philadelphia, Pennsylvania. B.E. Clauser is vice president, Measurement Consulting Services, National Board of Medical Examiners, Philadelphia, Pennsylvania.
authors.forename: Monica M
authors.initials: MM
authors.lastname: Cuddy
authors.forename: Marcia L
authors.initials: ML
authors.lastname: Winward
authors.forename: Mary M
authors.initials: MM
authors.lastname: Johnston
authors.forename: Rebecca S
authors.initials: RS
authors.lastname: Lipner
authors.forename: Brian E
authors.initials: BE
authors.lastname: Clauser
mesh_terms: D002170:Canada; D002983:Clinical Competence; D004521:Educational Measurement; D006801:Humans; D007388:Internal Medicine / Q000193:education*; D007396:Internship and Residency; D008007:Licensure, Medical; D016014:Linear Models; D008487:Medical History Taking; D010808:Physical Examination; D014481:United States