title: Towards outcome-based programme evaluation: using student comparative self-assessments to determine teaching effectiveness.
abstract: BACKGROUND
  Programme evaluation of medical education should be multi-dimensional. While structural and organisational aspects of teaching are frequently assessed, programme evaluation tools are rarely matched to specific learning objectives.
  
  
  OBJECTIVE
  This study used one medical school's catalogue of specific learning objectives to implement and critically appraise a novel programme evaluation tool based on comparative student self-assessments.
  
  
  METHODS
  Medical students enrolled in the clinical phase of the undergraduate curriculum in Göttingen were invited to self-rate their knowledge, skills and attitudes before and after each course. A newly developed formula controlling for student performance levels when entering a course was used to compute a percentage gain in knowledge, skills and attitudes. Data derived from a prospective, longitudinal intervention study on the development of electrocardiogram interpretation skills including 636 students from four consecutive cohorts were used to provide validity evidence of the new approach.
  
  
  RESULTS
  The novel tool appeared superior to plain mean differences and effect sizes in detecting outstanding teaching as well as shortcomings of the curriculum. In addition, it adequately reflected objectively measured performance levels and was responsive to curriculum change.
  
  
  CONCLUSIONS
  Comparative student self-assessment is a valid tool to appraise undergraduate medical curricula at the level of specific learning objectives.
authors.affiliation: Department of Cardiology and Pneumology, University Hospital Göttingen, Germany. raupach@med.uni-goettingen.de
authors.forename: T
authors.initials: T
authors.lastname: Raupach
authors.forename: C
authors.initials: C
authors.lastname: Münscher
authors.forename: T
authors.initials: T
authors.lastname: Beissbarth
authors.forename: G
authors.initials: G
authors.lastname: Burckhardt
authors.forename: T
authors.initials: T
authors.lastname: Pukrop
mesh_terms: D002983:Clinical Competence / Q000706:statistics & numerical data; D003479:Curriculum; D004504:Education, Medical, Undergraduate / Q000379:methods; D004521:Educational Measurement / Q000379:methods; D004522:Educational Status; D005858:Germany; D007722:Health Knowledge, Attitudes, Practice; D006801:Humans; D007858:Learning; D011361:Professional Competence / Q000592:standards / Q000706:statistics & numerical data*; D015397:Program Evaluation / Q000379:methods*; D012577:Schools, Medical; D012647:Self-Assessment; D013223:Statistics as Topic; D018709:Statistics, Nonparametric; D013337:Students, Medical / Q000706:statistics & numerical data*; D013663:Teaching / Q000592:standards*