Item and Test Analysis to Identify Quality Multiple Choice Questions (MCQs) from an Assessment of Medical Students of Ahmedabad, Gujarat.
BACKGROUND
Multiple choice questions (MCQs) are frequently used to assess students in different educational streams for their objectivity and wide reach of coverage in less time. However, the MCQs to be used must be of quality which depends upon its difficulty index (DIF I), discrimination index (DI) and distracter efficiency (DE).


OBJECTIVE
To evaluate MCQs or items and develop a pool of valid items by assessing with DIF I, DI and DE and also to revise/ store or discard items based on obtained results.


METHODS
Study was conducted in a medical school of Ahmedabad.


METHODS
An internal examination in Community Medicine was conducted after 40 hours teaching during 1(st) MBBS which was attended by 148 out of 150 students. Total 50 MCQs or items and 150 distractors were analyzed.


METHODS
Data was entered and analyzed in MS Excel 2007 and simple proportions, mean, standard deviations, coefficient of variation were calculated and unpaired t test was applied.


RESULTS
Out of 50 items, 24 had "good to excellent" DIF I (31 - 60%) and 15 had "good to excellent" DI (> 0.25). Mean DE was 88.6% considered as ideal/ acceptable and non functional distractors (NFD) were only 11.4%. Mean DI was 0.14. Poor DI (< 0.15) with negative DI in 10 items indicates poor preparedness of students and some issues with framing of at least some of the MCQs. Increased proportion of NFDs (incorrect alternatives selected by < 5% students) in an item decrease DE and makes it easier. There were 15 items with 17 NFDs, while rest items did not have any NFD with mean DE of 100%.


CONCLUSIONS
Study emphasizes the selection of quality MCQs which truly assess the knowledge and are able to differentiate the students of different abilities in correct manner.
Department of Community Medicine, Gujarat Medical Education and Research Society Medical College, Sola, Ahemdabad, Gujarat, India.
Sanju
S
Gajjar
Department of Community Medicine, Gujarat Medical Education and Research Society Medical College, Sola, Ahemdabad, Gujarat, India.
Rashmi
R
Sharma
Department of Community Medicine, Gujarat Medical Education and Research Society Medical College, Sola, Ahemdabad, Gujarat, India.
Pradeep
P
Kumar
Department of Community Medicine, Gujarat Medical Education and Research Society Medical College, Sola, Ahemdabad, Gujarat, India.
Manish
M
Rana
Difficulty index; discrimination index; distractor efficiency; multiple choice question or item; nonfunctional distractor (NFD); teaching evaluation