title: Accuracy of script concordance tests in fourth-year medical students.
abstract: OBJECTIVE
  This investigation aimed to determine the validity of script concordance test (SCT), compared with clinical-case-related short-answer management problems (SAMP), in fourth-year medical students.
  
  
  METHODS
  This retrospective study was conducted at the Medical School of Lille University. Cardiology and gynecology examinations both included 3 SCT and 2 clinical-case-related SAMP.  Final score did not include SCT results, and was out of 20 points. The passing score was ≥10/20. Wilcoxon and McNemar tests were used to compare quantitative and qualitative variables, respectively. Correlation between scores was also analyzed.
  
  
  RESULTS
  A total of 519 and 521 students completed SAMP and SCT in cardiology and gynecology, respectively. Cardiology score was significantly higher in SCT than SAMP (mean ± SD 13.5±2.4 versus 11.4±2.6, Wilcoxon test, p<0.001). In gynecology, SCT score was significantly lower than SAMP score (10.8±2.6 versus 11.4±2.7, Wilcoxon test, p=0.001). SCT and SAMP scores were significantly correlated (p <0.05, Pearson's correlation). However, percentage of students with SCT score ≥ 10/20 was similar among those who passed or failed cardiology (327 of 359 (91%) vs 146 of 160 (91%), χ2=0.004, df =1, p=0.952), or gynecology (274 of 379 (65%) vs 84 of 142 (59%), χ2=1.614, df=1, p=0.204) SAMP test. Cronbach alpha coefficient was 0.31 and 0.92 for all SCT and SAMP, respectively.
  
  
  CONCLUSIONS
  Although significantly correlated, the scores obtained in SCT and SAMP were significantly different in fourth-year medical students. These findings suggest that SCT should not be used for summative purposes in fourth-year medical students.
authors.affiliation: University of Lille, School of Medicine, Lille, France.
authors.forename: Saad
authors.initials: S
authors.lastname: Nseir
authors.affiliation: University Hospital of Lille, Critical Care Center, Lille, France.
authors.forename: Ahmed
authors.initials: A
authors.lastname: Elkalioubie
authors.affiliation: University of Lille, School of Medicine, Lille, France.
authors.forename: Philippe
authors.initials: P
authors.lastname: Deruelle
authors.affiliation: University of Lille, School of Medicine, Lille, France.
authors.forename: Dominique
authors.initials: D
authors.lastname: Lacroix
authors.affiliation: University of Lille, School of Medicine, Lille, France.
authors.forename: Didier
authors.initials: D
authors.lastname: Gosset
mesh_terms: D000328:Adult; D002309:Cardiology / Q000193:education; D002983:Clinical Competence; D004504:Education, Medical, Undergraduate; D004521:Educational Measurement / Q000379:methods*; D005260:Female; D006176:Gynecology / Q000193:education; D006801:Humans; D008297:Male; D012189:Retrospective Studies; D018709:Statistics, Nonparametric; D013337:Students, Medical; D055815:Young Adult
keywords: evaluation; fourth-year medical year; france; script concordance tests