Development of an instrument to assess individual student performance in small group tutorials.
Recognizing the need for a valid and reliable method to assess individual tutorial performance in a problem-based learning curriculum, we developed a 31-item instrument from theoretical frameworks and items used elsewhere. A scale was developed for each of three broad learning domains: self-directed learning (SDL), critical thinking (CT), and group process (GP). The instrument demonstrated high internal consistency (SDL = .88, CT = .90, GP = .83) on a sample of 18 tutors and 167 students. Tutor-student interrater reliability coefficients were estimated to be low (SDL = .16, CT = .18, GP = .14) due to lack of variance on the response scale. The instrument showed high correlation (r = .82) with other forms of summative evaluation. In its current form, this standardized and validated instrument is unreliable in differentiating strong from weak tutorial performance but can have a steering effect on student tutorial behaviors. The process of instrument development has general application to other educational programs.
Ladouceur
Michael G
MG
McMaster University, School of Nursing, HSC-2J26, 1200 Main Street West, Hamilton, Ontario, Canada L8N 3Z5. ladouce@mcmaster.ca
Rideout
Elizabeth M
EM
Black
Margaret E A
ME
Crooks
Dauna L
DL
O'Mara
Linda M
LM
Schmuck
Mary Lou
ML
D001291:Attitude of Health Personnel; D002983:Clinical Competence / Q000592:standards; D003479:Curriculum / Q000592:standards; D004508:Education, Nursing, Baccalaureate / Q000592:standards; D004521:Educational Measurement / Q000379:methods* / Q000592:standards; D030141:Feedback, Psychological; D006126:Group Processes; D007722:Health Knowledge, Attitudes, Practice; D006801:Humans; D017145:Models, Educational; D015402:Nursing Education Research; D015404:Nursing Methodology Research; D015588:Observer Variation; D009864:Ontario; D010687:Philosophy, Nursing; D018794:Problem-Based Learning / Q000592:standards; D011594:Psychometrics; D036301:Qualitative Research; D012107:Research Design; D012647:Self-Assessment; D013338:Students, Nursing / Q000523:psychology; D013663:Teaching / Q000592:standards; D013850:Thinking