title: The validity and reliability of the sixth-year internal medical examination administered at the King Abdulaziz University Medical College.
abstract: BACKGROUND
  Exams are essential components of medical students' knowledge and skill assessment during their clinical years of study. The paper provides a retrospective analysis of validity evidence for the internal medicine component of the written and clinical exams administered in 2012 and 2013 at King Abdulaziz University's Faculty of Medicine.
  
  
  METHODS
  Students' scores for the clinical and written exams were obtained. Four faculty members (two senior members and two junior members) were asked to rate the exam questions, including MCQs and OSCEs, for evidence of content validity using a rating scale of 1-5 for each item. Cronbach's alpha was used to measure the internal consistency reliability. Correlations were used to examine the associations between different forms of assessment and groups of students.
  
  
  RESULTS
  A total of 824 students completed the internal medicine course and took the exam. The numbers of rated questions were 320 and 46 for the MCQ and OSCE, respectively. Significant correlations were found between the MCQ section, the OSCE section, and the continuous assessment marks, which include 20 long-case presentations during the course; participation in daily rounds, clinical sessions and tutorials; the performance of simple procedures, such as IV cannulation and ABG extraction; and the student log book. Although the OSCE exam was reliable for the two groups that had taken the final clinical OSCE, the clinical long- and short-case exams were not reliable across the two groups that had taken the oral clinical exams. The correlation analysis showed a significant linear association between the raters with respect to evidence of content validity for both the MCQ and OSCE, r = .219 P < .001 and r = .678 P < .001, respectively, and r = .241 P < .001 and r = .368 P = .023 for the internal structure validity, respectively. Reliability measured using Cronbach's alpha was greater for assessments administered in 2013.
  
  
  CONCLUSIONS
  The pattern of relationships between the MCQ and OSCE scores provides evidence of the validity of these measures for use in the evaluation of knowledge and clinical skills in internal medicine. The OSCE exam is more reliable than the short- and long-case clinical exams and requires less effort on the part of examiners and patients.
authors: Faculty of Medicine, King Abdulaziz University, Jeddah, Saudi Arabia. hindfallatah@hotmail.com.
authors: Hind I
authors: HI
authors: Fallatah
authors: Department of Medical Education, College of Medicine, University of Illinois, Chicago, IL, USA. tekian@uic.edu.
authors: Ara
authors: A
authors: Tekian
authors: Department of Medical Education, College of Medicine, University of Illinois, Chicago, IL, USA. yspark2@uic.edu.
authors: Yoon Soo
authors: YS
authors: Park
authors: Faculty of Medicine, King Abdulaziz University, Jeddah, Saudi Arabia. ommali@yahoo.com.
authors: Lana
authors: L
authors: Al Shawa
mesh_terms: D003162:Competency-Based Education / Q000458:organization & administration; D004501:Education, Medical / Q000458:organization & administration*; D004521:Educational Measurement; D005260:Female; D006801:Humans; D007388:Internal Medicine / Q000193:education*; D008297:Male; D015203:Reproducibility of Results; D012189:Retrospective Studies; D012529:Saudi Arabia
references: Med Educ. 1990 May;24(3):219-23
references: 2355864
references: S Afr Med J. 1985 May 17;67(20):810-2
references: 3992412
references: Med Educ. 1984 Mar;18(2):106-9
references: 6700444
references: Med Educ. 2001 Sep;35(9):841-6
references: 11555221
references: Fam Med. 2008 Sep;40(8):574-8
references: 18988044
references: Med Educ. 2005 Mar;39(3):276-83
references: 15733163
references: Med Educ. 2011 Dec;45(12):1181-9
references: 21988659