[Cues and pseudocues in surgical multiple choice questions from the German state examination].
OBJECTIVE
Multiple choice questions (MCQs) are the most common written test item in medical examinations. Writing MCQs is difficult and cues can decrease test validity. The aim of this article is to describe the prevalence and pattern of cues in surgical MCQs in the central German medical examination questions from 2000-2011.


METHODS
All surgical questions were entered into a database. The questions were reviewed for cues and pseudocues independently by three students of different academic background and one clinical physician.


RESULTS
Initially, 1014 questions were included, 22 questions were not rated uniformly by the reviewers and 3 questions were excluded because no consensus could be reached. Overall 15.2 % of the questions analyzed contained some type of cue or pseudocue. Of the total questions 0.2 % contained type A cues (i.e. disruption of grammatical flow), 6.5 % contained type B cues (i.e. heterogeneous length or differentiation), 4.0 % contained type C cues (two or more answers described closely related topics, serving to focus attention), 0.6 % contained type D convergence cues (i.e. answers with the most items in common with distractors are correct), 0.7 % contained type E verbal association cues (i.e. connection in the use of words leading to the correct answer) and 1.0 % contained type F cues (i.e. answers with absolute terms). Pseudocues were found in 3.7 % of the questions.


CONCLUSIONS
The proportion of questions that contained cues or pseudocues should lead to further efforts to avoid such factors compromising test reliability by specific attention in the process of question design and review.


CONCLUSIONS
Cues are still an important consideration in designing MCQs and are present in considerable numbers in medical state examination questions. Pseudocues should be explicitly avoided so as not to compromise validity and reliability.
Abt Allgemeine Pädiatrie und Neonatologie, Universitätsklinikum Giessen und Marburg, Standort Gießen, Feulgenstr 14, 35392, Gießen, Deutschland. Jan.delaffolie@paediat.med.uni-giessen.de.|Klinik für Kinderchirurgie und angeborene Fehlbildungen, Horst-Schmidt-Klinik Wiesbaden, Wiesbaden, Deutschland. Jan.delaffolie@paediat.med.uni-giessen.de.
J
J
de Laffolie
Abt Allgemeine Pädiatrie und Neonatologie, Universitätsklinikum Giessen und Marburg, Standort Gießen, Feulgenstr 14, 35392, Gießen, Deutschland.
D
D
Visser
Abteilung für Chirurgie, Städtisches Krankenhaus Worms, Worms, Deutschland.
M
M
Hirschburger
Klinik für Kinderchirurgie und angeborene Fehlbildungen, Horst-Schmidt-Klinik Wiesbaden, Wiesbaden, Deutschland.
S
S
Turial
D003463:Cues; D004521:Educational Measurement; D013502:General Surgery / Q000193:education*; D005858:Germany; D006801:Humans; D011795:Surveys and Questionnaires
Assessment; Cues; Medical Education; Multiple Choice Questions; Surgical Education
Radiographics. 2006 Mar-Apr;26(2):543-51
16549616
Acad Med. 2002 Feb;77(2):156-61
11841981
Med Teach. 1979;1(6):303
24483305
Med Teach. 2004 Dec;26(8):709-12
15763874
J Dent Educ. 2013 Dec;77(12):1593-609
24319131