title: Local development of MCQ tests for evidence-based medicine and clinical decision making can be successful.
abstract: BACKGROUND
  Guidelines for the design of multiple-choice item (MCQ) tests of evidence-based medicine (EBM) and clinical decision making (CDM) have not been published.
  
  
  OBJECTIVE
  We describe a strategy to develop an EBM/CDM MCQ test database guided by educational theory and used psychometric analyses, including reliability, validity, and item analyses, to judge the strategy's success.
  
  
  RESULTS
  The internal consistency reliability of tests derived from the database was in the good-to-excellent range (0.74-0.95) and test-retest reliability was fair (0.51). One test discriminated across three levels of EBM/CDM learners (discriminant validity). Tests also predictively correlated with other medical school assessments according to theory (convergent and discriminant validity). The items were infrequently misclassified, had statistics close to historical standards, and were acceptable after no more than one round of revisions.
  
  
  CONCLUSIONS
  Our strategy for developing an EBM/CDM MCQ database was successful and tests derived from it can be flexibly sampled to assess different EBM/CDM knowledge domains and three levels of EBM/CDM learners. Assuming the availability of similar resources to support its application, this strategy should be replicable at other settings.
authors.affiliation: Department of Medicine, Georgia Health Sciences University/University of Georgia Medical Partnership, Athens, GA, USA. gcrites@uga.edu
authors.forename: Gerald E
authors.initials: GE
authors.lastname: Crites
authors.forename: Ronald J
authors.initials: RJ
authors.lastname: Markert
authors.forename: D Stephen
authors.initials: DS
authors.lastname: Goggans
authors.forename: W Scott
authors.initials: WS
authors.lastname: Richardson
mesh_terms: D002983:Clinical Competence; D003479:Curriculum; D003657:Decision Making; D004504:Education, Medical, Undergraduate / Q000379:methods*; D004522:Educational Status; D019317:Evidence-Based Medicine / Q000379:methods*; D007722:Health Knowledge, Attitudes, Practice; D006801:Humans; D007858:Learning; D011594:Psychometrics; D015203:Reproducibility of Results; D013337:Students, Medical / Q000523:psychology*; D013663:Teaching / Q000379:methods