title: Self and peer assessment in tutorials: application of a relative-ranking model.
abstract: OBJECTIVE
  While self assessment continues to be touted as being of paramount importance for continuing professional competence, problem-based learning curricula, and adult learning theory, techniques for ensuring valid judgments have proven elusive. This study tested the applicability of an innovative relative-ranking procedure to problem-based learning tutorials.
  
  
  METHODS
  A total of 36 students in the McMaster University Faculty of Health Sciences' MD program were provided relative-ranking forms listing seven domains of competence along with their definitions. The student, two of the student's peers, and the student's tutor were asked to complete the ranking exercise after their second, fourth, and sixth tutorials.
  
  
  RESULTS
  Combining each level of the time and rater variables generated 66 correlation coefficients, none of which was significantly different from zero. Re-performing the analysis on only the extreme domains did not improve this result.
  
  
  CONCLUSIONS
  The relative-ranking instrument developed did not prove to be a reliable measure of tutorial performance. Ratings were inconsistent from one week to the next as well as across raters within a week.
authors.affiliation: Department of Medicine, Health Sciences Centre, McMaster University, Hamilton, ON, Canada.
authors.forename: Harold I
authors.initials: HI
authors.lastname: Reiter
authors.forename: Kevin W
authors.initials: KW
authors.lastname: Eva
authors.forename: Rose M
authors.initials: RM
authors.lastname: Hatala
authors.forename: Geoffrey R
authors.initials: GR
authors.lastname: Norman
mesh_terms: D001291:Attitude of Health Personnel; D003142:Communication; D003479:Curriculum; D006801:Humans; D017145:Models, Educational; D010379:Peer Group; D018794:Problem-Based Learning; D012647:Self-Assessment; D013337:Students, Medical / Q000523:psychology*