title: Examiner characteristics and interrater reliability in a communication OSCE.
abstract: To identify inter-individual examiner factors associated with interrater reliability in a summative communication OSCE in the 4th study year.
  
  
  
  The OSCE consists of 4 stations assessed with a 4-item 5-point global rating instrument. A bivariate secondary analysis of interrater reliability in relation to 4 examiner factors (gender, profession, OSCE experience, examiner training) was conducted. Intraclass correlation coefficients (ICC) were calculated and compared between examiner dyads of different similarity.
  
  
  
  169 pairwise ratings from 19 different examiners in 16 dyads were analysed. Interrater reliability is significantly higher in examiner dyads of same vs. different gender (ICC=0.76 (95%CI=0.65-0.83) vs. ICC=0.41 (95%CI=0.21-0.57)), in dyads of two clinicians vs. non-clinical/mixed professions (ICC=0.72 (95%CI=0.56-0.83) vs. ICC=0.57 (95%CI=0.41-0.69)), and in dyads with high vs. low/mixed OSCE experience (ICC=0.73 (95%CI 0.50-0.87) vs. ICC=0.56 (95%CI=0.41-0.69)). Participation in recent examiner training had no influence on ICCs.
  
  
  
  Better concordance of ratings between clinically active examiners might be a hint for context specificity of good communication. Higher interrater reliability between examiners with same gender may indicate gender-specific communication concepts.
  
  
  
  Medical faculties introducing summative assessment of communication competence should focus the influence of examiner characteristics on interrater reliability.
authors.affiliation: Heinrich-Heine-University Düsseldorf, Medical Faculty, Institute of General Practice, Werdener Str. 7, 40227 Düsseldorf, Germany.
authors.forename: Achim
authors.initials: A
authors.lastname: Mortsiefer
authors.affiliation: Heinrich-Heine-University Düsseldorf, Medical Faculty, Clinical Institute of Psychosomatic Medicine and Psychotherapy, Moorenstr. 5, 40225, Düsseldorf, Germany,. Electronic address: Andre.Karger@med.uni-duesseldorf.de.
authors.forename: André
authors.initials: A
authors.lastname: Karger
authors.affiliation: Heinrich-Heine-University Düsseldorf, Medical Faculty, Deanery of Study and Department for Endocrinology, Diabetes, and Rheumatology, Moorenstr. 5, 40225 Düsseldorf, Germany. Electronic address: Rotthoff@med.uni-duesseldorf.de.
authors.forename: Thomas
authors.initials: T
authors.lastname: Rotthoff
authors.affiliation: Heinrich-Heine-University Düsseldorf, Medical Faculty, Deanery of Study and Clinical Institute of Psychosomatic Medicine and Psychotherapy, Moorenstr. 5, 40225 Düsseldorf, Germany. Electronic address: Bianca.Raski@med.uni-duesseldorf.de.
authors.forename: Bianca
authors.initials: B
authors.lastname: Raski
authors.affiliation: Heinrich-Heine-University Düsseldorf, Medical Faculty, Institute of General Practice, Werdener Str. 7, 40227 Düsseldorf, Germany. Electronic address: Pentzek@med.uni-duesseldorf.de.
authors.forename: Michael
authors.initials: M
authors.lastname: Pentzek
mesh_terms: D002983:Clinical Competence; D003142:Communication; D004504:Education, Medical, Undergraduate; D004521:Educational Measurement / Q000379:methods*; D005260:Female; D006801:Humans; D008297:Male; D010817:Physician-Patient Relations; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D013337:Students, Medical
keywords: Assessment; Communication competence; Examiner factors; OSCE