Student Practice Evaluation Form-Revised Edition online comment bank: development and reliability analysis.
OBJECTIVE
The reliable evaluation of occupational therapy students completing practice education placements along with provision of appropriate feedback is critical for both students and for universities from a quality assurance perspective. This study describes the development of a comment bank for use with an online version of the Student Practice Evaluation Form-Revised Edition (SPEF-R Online) and investigates its reliability.


METHODS
A preliminary bank of 109 individual comments (based on previous students' placement performance) was developed via five stages. These comments reflected all 11 SPEF-R domains. A purpose-designed online survey was used to examine the reliability of the comment bank. A total of 37 practice educators returned surveys, 31 of which were fully completed. Participants were asked to rate each individual comment using the five-point SPEF-R rating scale.


RESULTS
One hundred and two of 109 comments demonstrated satisfactory agreement with their respective default ratings that were determined by the development team. At each domain level, the intra-class correlation coefficients (ranging between 0.86 and 0.96) also demonstrated good to excellent inter-rater reliability. There were only seven items that required rewording prior to inclusion in the final SPEF-R Online comment bank.


CONCLUSIONS
The development of the SPEF-R Online comment bank offers a source of reliable comments (consistent with the SPEF-R rating scale across different domains) and aims to assist practice educators in providing reliable and timely feedback to students in a user-friendly manner.
Occupational Therapy Division, School of Health and Rehabilitation Sciences, The University of Queensland, Brisbane, Queensland, Australia.
Sylvia
S
Rodger
Merrill
M
Turpin
Jodie
J
Copley
Allison
A
Coleman
Chi-Wen
CW
Chien
Anne-Maree
AM
Caine
Ted
T
Brown
D002983:Clinical Competence / Q000592:standards; D004521:Educational Measurement / Q000379:methods*; D005246:Feedback; D005260:Female; D006801:Humans; D020407:Internet; D008297:Male; D009788:Occupational Therapy / Q000193:education*; D015203:Reproducibility of Results
education; professional; reproducibility of results