title: Development of an instrument to assess individual student performance in small group tutorials.
abstract: Recognizing the need for a valid and reliable method to assess individual tutorial performance in a problem-based learning curriculum, we developed a 31-item instrument from theoretical frameworks and items used elsewhere. A scale was developed for each of three broad learning domains: self-directed learning (SDL), critical thinking (CT), and group process (GP). The instrument demonstrated high internal consistency (SDL = .88, CT = .90, GP = .83) on a sample of 18 tutors and 167 students. Tutor-student interrater reliability coefficients were estimated to be low (SDL = .16, CT = .18, GP = .14) due to lack of variance on the response scale. The instrument showed high correlation (r = .82) with other forms of summative evaluation. In its current form, this standardized and validated instrument is unreliable in differentiating strong from weak tutorial performance but can have a steering effect on student tutorial behaviors. The process of instrument development has general application to other educational programs.
authors.affiliation: McMaster University, School of Nursing, HSC-2J26, 1200 Main Street West, Hamilton, Ontario, Canada L8N 3Z5. ladouce@mcmaster.ca
authors.forename: Michael G
authors.initials: MG
authors.lastname: Ladouceur
authors.forename: Elizabeth M
authors.initials: EM
authors.lastname: Rideout
authors.forename: Margaret E A
authors.initials: ME
authors.lastname: Black
authors.forename: Dauna L
authors.initials: DL
authors.lastname: Crooks
authors.forename: Linda M
authors.initials: LM
authors.lastname: O'Mara
authors.forename: Mary Lou
authors.initials: ML
authors.lastname: Schmuck
mesh_terms: D001291:Attitude of Health Personnel; D002983:Clinical Competence / Q000592:standards; D003479:Curriculum / Q000592:standards; D004508:Education, Nursing, Baccalaureate / Q000592:standards; D004521:Educational Measurement / Q000379:methods* / Q000592:standards; D030141:Feedback, Psychological; D006126:Group Processes; D007722:Health Knowledge, Attitudes, Practice; D006801:Humans; D017145:Models, Educational; D015402:Nursing Education Research; D015404:Nursing Methodology Research; D015588:Observer Variation; D009864:Ontario; D010687:Philosophy, Nursing; D018794:Problem-Based Learning / Q000592:standards; D011594:Psychometrics; D036301:Qualitative Research; D012107:Research Design; D012647:Self-Assessment; D013338:Students, Nursing / Q000523:psychology; D013663:Teaching / Q000592:standards; D013850:Thinking