Assessing students' research reports: development of a rating scale.
BACKGROUND
There is a lack of explicit criteria for the assessment of students' research reports. Teachers tend to use their own, idiosyncratic sets of implicit criteria. A well-defined set of criteria could foster reliable and valid assessment of students' research reports.


OBJECTIVE
The aim of this study was twofold: to detect the strengths and weaknesses of students' research reports and to develop an assessment tool for students' research papers.


METHODS
On the basis of the literature and advice from experts, we developed a list of 19 criteria, comprising 15 specific items and 4 global items. Three raters, using the list, independently scored a sample of 18 research reports.


RESULTS
The strengths of the reports were the structure of the results and the description of materials and methods. The weaknesses were the research questions, the grounding of the study in the research literature, the analysis, the statistics, and the clarity of visuals. With three raters, the reliability of the rating scale was reasonable.


CONCLUSIONS
The rating scale seems to be a useful tool for judging and giving feedback on students' research reports. These findings will have to be confirmed in studies with larger samples.
Jaarsma
Debbie A D C
DA
Faculty of Veterinary Medicine, Department of Education and Student Affairs, Utrecht University, PO Box 80163, 3508 TD Utrecht, The Netherlands. a.d.c.jaarsma@uu.nl
Kranenbarg
Wouter J
WJ
Dolmans
Diana H J M
DH
Muijtjens
Arno M M
AM
Scherpbier
Albert J J A
AJ
Van Beukelen
Peter
P
D004521:Educational Measurement / Q000379:methods* / Q000592:standards; D006801:Humans; D012106:Research; D012107:Research Design / Q000592:standards*; D013337:Students, Medical