Is Cronbach's alpha sufficient for assessing the reliability of the OSCE for an internal medicine course?
BACKGROUND
The number of medical students accepted into medical programs is increasing, which has made the traditional long/short case style of examination difficult to conduct. At Dammam University, the program is shifting to the use of the Objective Structural Clinical Examination (OSCE), which may solve some of these difficulties, including issues with reliability, validity index and exam duration.


RESULTS
A pilot study was conducted over one semester. A total of 207 examinees in three groups took the OSCE and written exams. The OSCE consisted of 18 clinical stations and required 3-4.3 h/day. The written exam contained 80 multiple-choice questions. The Cronbach's alpha for each group was 0.7, 0.8, and 0.9. Correlations for all stations ranged from 0.7 to 0.8, which indicated good stability and internal consistency with minor differences in the progression of the indexes. The reliability of the written exam was 0.79, and the validity of the OSCE was 0.63, as assessed using Pearson's correlation.


CONCLUSIONS
No single reliability index can be considered a perfect assessment tool to solve this issue. Thus, at least two to three indexes should be used to ensure the reliability of the OSCE.
University of Dammam, Prince Saud bin Fahd Street, PO Box 3669, Khobar, 31952, Saudi Arabia. aosail@yahoo.com.
Aisha M
AM
Al-Osail
University of Dammam, PO Box 2435, Dammam, 31451, Saudi Arabia. mhalsheikh@ud.edu.sa.
Mona H
MH
Al-Sheikh
University of Dammam, Prince Saud bin Fahd Street, PO Box 3669, Khobar, 31952, Saudi Arabia. Emad2022@hotmail.com.
Emad M
EM
Al-Osail
University of Dammam, PO Box 2435, Dammam, 31451, Saudi Arabia. Mohannad.uod@hotmail.com.
Mohannad A
MA
Al-Ghamdi
University of Dammam, PO Box 2435, Dammam, 31451, Saudi Arabia. Sas.7@hotmail.com.
Abdulaziz M
AM
Al-Hawas
University of Dammam, PO Box 2435, Dammam, 31451, Saudi Arabia. Asa1992@windowslive.com.
Abdullah S
AS
Al-Bahussain
University of Dammam, PO Box 2435, Dammam, 31451, Saudi Arabia. dajaniaa@gmail.com.
Ahmed A
AA
Al-Dajani
D003479:Curriculum; D004521:Educational Measurement; D005163:Factor Analysis, Statistical; D005260:Female; D006801:Humans; D007388:Internal Medicine; D008297:Male; D015203:Reproducibility of Results; D013223:Statistics as Topic