title: Assessing medical student competency in communication in the pre-clinical phase: objective structured video exam and SP exam.
abstract: OBJECTIVE
  The aim of our study was to present the structure, process and results of the objective structured video exam and One-Station standardized patient exam that have been used to assess second year medical students' communication skills.
  
  
  METHODS
  Scores of 1137 students between the years 2007 and 2010 were analyzed. Means and standard deviations were calculated for scores and ratings. Internal consistency was assessed using Cronbach's alpha coefficient. To analyze reliability and generalizability, multivariate generalizability theory was employed.
  
  
  RESULTS
  Students' total and item scores on the objective structured video exam (60.5-68.8) were lower than on the One-Station standardized patient exam (90.4-96.6). Internal consistencies of both exams were moderate. Generalizability analysis and D-study results showed that both the objective structured video exam and the One-Station standardized patient exam need improvement.
  
  
  CONCLUSIONS
  Both exams need measures to improve them, such as increasing the number of video cases or stations, and further standardization of raters.
  
  
  CONCLUSIONS
  This study might encourage medical teachers to consider assessing validity and reliability of written and performance exams on the basis of generalizability theory, and to find out feasible actions to improve assessment procedures by conducting a D-study.
authors.affiliation: Department of Medical Education, Ege University Faculty of Medicine, Izmir, Turkey. osurelkarabilgin@gmail.com
authors.forename: Ozlem Surel
authors.initials: OS
authors.lastname: Karabilgin
authors.forename: Kevser
authors.initials: K
authors.lastname: Vatansever
authors.forename: Suleyman Ayhan
authors.initials: SA
authors.lastname: Caliskan
authors.forename: Halil İbrahim
authors.initials: Hİ
authors.lastname: Durak
mesh_terms: D000328:Adult; D002983:Clinical Competence; D003142:Communication; D004504:Education, Medical, Undergraduate / Q000592:standards*; D004521:Educational Measurement / Q000379:methods*; D005260:Female; D006801:Humans; D008297:Male; D015999:Multivariate Analysis; D016544:Patient Simulation; D015203:Reproducibility of Results; D013337:Students, Medical / Q000523:psychology*; D014421:Turkey; D014743:Videotape Recording; D014956:Writing; D055815:Young Adult