title: A systematic review of evaluation in formal continuing medical education.
abstract: BACKGROUND
  Physicians spend a considerable amount of time in Continuing Medical Education (CME) to maintain their medical licenses. CME evaluation studies vary greatly in evaluation methods, levels of evaluation, and length of follow-up. Standards for CME evaluation are needed to enable comparison among different studies and to detect factors influencing CME evaluation.
  
  
  METHODS
  A review of the CME evaluation literature was conducted on primary research studies published from January 2000 to January 2006. Studies assessing only satisfaction with CME were excluded, as were studies where fewer than 50% of the participants were practicing physicians. Thirty-two studies were included in the analyses. Determinations were made about evaluation methods, outcome measures, and follow-up assessment.
  
  
  RESULTS
  Only 2 of 32 reviewed studies addressed all evaluation levels: physician changes in knowledge and attitudes (level 2), practices (level 3), and improved patient health status (level 4). None of the studies using self-developed instruments (n = 10) provided reliability and validity information. Only 6 studies used validated scales. Twenty studies had a follow-up period of 6 months or less, and 11 had a follow-up period between 1 and 2 years.
  
  
  CONCLUSIONS
  A gold standard for evaluating the effectiveness of CME would include assessment of all 4 levels of evaluation. A valid, reliable, and adaptable CME evaluation questionnaire addressing variables in the second level is needed to allow comparison of effectiveness across CME interventions. A minimum 1-year postintervention follow-up period may also be indicated to investigate the sustainability of intervention outcomes.
authors: Department of Public and Community Health, University of Maryland, College Park, MD 20742-2611, USA. tianjing@umd.edu
authors: Jing
authors: J
authors: Tian
authors: Nancy L
authors: NL
authors: Atkinson
authors: Barry
authors: B
authors: Portnoy
authors: Robert S
authors: RS
authors: Gold
mesh_terms: D002983:Clinical Competence; D004502:Education, Medical, Continuing / Q000379:methods*; D004521:Educational Measurement / Q000379:methods*; D005069:Evaluation Studies as Topic; D006801:Humans; D016032:Randomized Controlled Trials as Topic; D015203:Reproducibility of Results