title: Faculty development on item writing substantially improves item quality.
abstract: The quality of items written for in-house examinations in medical schools remains a cause of concern. Several faculty development programs are aimed at improving faculty's item writing skills. The purpose of this study was to evaluate the effectiveness of a faculty development program in item development. An objective method was developed and used to assess improvement in faculty's competence to develop high quality test items. This was a quasi experimental study with a pretest-midtest-posttest design. A convenience sample of 51 faculty members participated. Structured checklists were used to assess the quality of test items at each phase of the study. Group scores were analyzed using repeated measures analysis of variance. The results showed a significant increase in participants' mean scores on Multiple Choice Questions, Short Answer Questions and Objective Structured Clinical Examination checklists from pretest to posttest (p < .0005). The effect sizes were 1.38, 3.84 and 2.20 for Multiple Choice Questions, Short Answer Questions and Objective Structured Clinical Examination, respectively. This study emphasizes that items written by faculty without faculty development are generally lacking in quality. It also provides evidence of the value of faculty development in improving the quality of items generated by faculty.
authors.affiliation: King Saud University Chair for Medical Education Research and Development, Department of Family and Community Medicine, College of Medicine, King Saud University, Kingdom of Saudi Arabia. naghma.naeem@gmail.com
authors.forename: Naghma
authors.initials: N
authors.lastname: Naeem
authors.forename: Cees
authors.initials: C
authors.lastname: van der Vleuten
authors.forename: Eiad Abdelmohsen
authors.initials: EA
authors.lastname: Alfaris
mesh_terms: D057189:Checklist; D004504:Education, Medical, Undergraduate; D004521:Educational Measurement; D005180:Faculty, Medical; D006801:Humans; D010154:Pakistan; D013192:Staff Development; D014956:Writing / Q000592:standards*