A simple instrument for the assessment of student performance in problem-based learning tutorials.
BACKGROUND
A process-oriented instrument was developed for the summative assessment of student performance during problem-based learning (PBL) tutorials. This study evaluated (1) the acceptability of the instrument by tutors and (2) the consistency of assessment scores by different raters.


METHODS
A survey of the tutors who had used the instrument was conducted to determine whether the assessment instrument or form was user-friendly. The 4 competencies assessed, using a 5-point rating scale, were (1) participation and communication skills, (2) cooperation or team-building skills, (3) comprehension or reasoning skills and (4) knowledge or information-gathering skills. Tutors were given a set of criteria guidelines for scoring the students' performance in these 4 competencies. Tutors were not attached to a particular PBL group, but took turns to facilitate different groups on different case or problem discussions. Assessment scores for one cohort of undergraduate medical students in their respective PBL groups in Year I (2003/2004) and Year II (2004/2005) were analysed. The consistency of scores was analysed using intraclass correlation.


RESULTS
The majority of the tutors surveyed expressed no difficulty in using the instrument and agreed that it helped them assess the students fairly. Analysis of the scores obtained for the above cohort indicated that the different raters were relatively consistent in their assessment of student performance, despite a small number consistently showing either "strict" or "indiscriminate" rating practice.


CONCLUSIONS
The instrument designed for the assessment of student performance in the PBL tutorial classroom setting is user-friendly and is reliable when used judiciously with the criteria guidelines provided.
Sim
Si-Mui
SM
Department of Pharmacology, Faculty of Medicine, University of Malaya, Kuala Lumpur, Malaysia. debrasim@um.edu.my
Azila
Nor Mohd Adnan
NM
Lian
Lay-Hoong
LH
Tan
Christina P L
CP
Tan
Nget-Hong
NH
D004501:Education, Medical / Q000379:methods* / Q000592:standards; D004521:Educational Measurement / Q000379:methods*; D006801:Humans; D018794:Problem-Based Learning / Q000592:standards*; D012189:Retrospective Studies; D013337:Students, Medical; D011795:Surveys and Questionnaires / Q000592:standards*