title: Evaluating medical residents' literature-appraisal skills.
abstract: BACKGROUND
  Measuring critical-appraisal skills is a key step in assessing physicians' abilities to engage in self-directed learning. The authors developed an instrument to evaluate the abilities of residents to critically appraise a journal article.
  
  
  METHODS
  In 1991, 62 residents in the categorical internal medicine program at the New England Medical Center were asked to respond to a questionnaire, evaluate a sample article, and complete a self-assessment of competence in evaluation of research. Critical-appraisal skill was determined by calculating the resident's deviations from a "gold standard" critique developed through a modified Delphi technique, using a panel of five physicians. Spearman correlation coefficients were used to compare the residents' actual and self-perceived abilities.
  
  
  RESULTS
  Twenty-eight residents returned the questionnaire, for a response rate of 45%. The composite score for the residents' objective assessments was 63% of the gold standard, and was not significantly correlated with post-graduate year, prior journal club experience, or self-assessed critical-appraisal skill.
  
  
  CONCLUSIONS
  After further validation in other settings, the assessment instrument in this study may be used to objectively assess critical-reading skills. It may also provide feedback and measure outcomes for interventions designed to improve critical reading.
authors.affiliation: Department of Medicine, New England Medical Center (NEMC), Boston, MA.
authors.forename: D T
authors.initials: DT
authors.lastname: Stern
authors.forename: M
authors.initials: M
authors.lastname: Linzer
authors.forename: P S
authors.initials: PS
authors.lastname: O'Sullivan
authors.forename: L
authors.initials: L
authors.lastname: Weld
mesh_terms: D007388:Internal Medicine / Q000193:education*; D007396:Internship and Residency; D010506:Periodicals as Topic; D011361:Professional Competence; D011932:Reading; D012655:Self-Evaluation Programs