title: The clinical integrative puzzle for teaching and assessing clinical reasoning: preliminary feasibility, reliability, and validity evidence.
abstract: BACKGROUND
  Expertise in clinical reasoning is essential for high-quality patient care. The Clinical Integrative Puzzle (CIP) is a novel assessment method for clinical reasoning. The purpose of our study was to further describe the CIP, providing feasibility, reliability, and validity evidence to support this tool for teaching and evaluating clinical reasoning.
  
  
  METHODS
  We conducted a prospective, randomized crossover trial assessing the CIP in second-year medical students from a single institution. Feasibility was estimated through the time taken to complete a CIP during a CIP session and through comments from faculty developers. Reliability was addressed through calculating odd-even item reliability (split-half procedure) for grid questions within each CIP. Evidence for content, concurrent, and predictive validity was also measured.
  
  
  RESULTS
  36 students participated in the study. Data suggested successful randomization of participants and nonparticipants. The CIP was found to have high feasibility, acceptable reliability (0.43-0.73 with a mean of 0.60) with a short time for CIP completion. Spearman-Brown correction estimated a reliability of 0.75 with completing two grids (estimated time of 50 minutes) and 0.82 for three grids (estimated time of 75 minutes). Validity evidence was modest; the CIP is consistent with clinical reasoning literature and the CIP modestly correlated with small group performance (r = 0.3, p < 0.05).
  
  
  CONCLUSIONS
  Assessing clinical reasoning in medical students is challenging. Our data provide good feasibility and reliability evidence for the use of CIPs; validity data was less robust.
authors: Department of Medicine, Uniformed Services University of the Health Sciences, 4301 Jones Bridge Road, Bethesda, MD 20814.
authors: Vincent F
authors: VF
authors: Capaldi
authors: Department of Medicine, Uniformed Services University of the Health Sciences, 4301 Jones Bridge Road, Bethesda, MD 20814.
authors: Steven J
authors: SJ
authors: Durning
authors: Department of Medicine, Uniformed Services University of the Health Sciences, 4301 Jones Bridge Road, Bethesda, MD 20814.
authors: Louis N
authors: LN
authors: Pangaro
authors: Bruce Rappaport Faculty of Medicine, Technion-Israel Institute of Technology, Haifa, Israel.
authors: Rosalie
authors: R
authors: Ber
mesh_terms: D000328:Adult; D002983:Clinical Competence; D018592:Cross-Over Studies; D003479:Curriculum; D004501:Education, Medical; D004521:Educational Measurement / Q000379:methods*; D005240:Feasibility Studies; D005260:Female; D006801:Humans; D008297:Male; D011446:Prospective Studies; D015203:Reproducibility of Results; D013337:Students, Medical / Q000706:statistics & numerical data*; D013850:Thinking; D014481:United States