Comparison between computer-aided testing and traditional multiple choice: an equivalence study.
OBJECTIVE
Computer-aided learning (CAL) is a viable alternative to traditional teaching methods. While CAL is used for teaching only, computer-aided testing (CAT) can be applied as a computer-based examination method. The aim of the present study was to compare the performance of undergraduate students in computer-interactive tests and traditional multiple choice tests and to evaluate the influence of question length and language skills on test results.


METHODS
Fifty-two native German-speaking students and five non-native speaking students were randomly assigned to two groups. They were required to answer 20 conventional multiple choice questions and 20 questions using the interactive MobiTed system. An analysis of variance and t-tests (alpha = 0.05) were used to compare scores.


RESULTS
Non-native speakers scored significantly lower on the interactive test compared with the native speaking students (P = 0.048 for long questions and P = 0.003 for short questions). There were no significant group differences on the conventional multiple choice test (P = 0.052 for long questions and P = 0.089 for short questions). Based on the results of the native speaking students neither test method nor question length had an influence on overall performance.


CONCLUSIONS
Interactive multiple choice tests may provide an alternative to written tests, especially when considering time expenditure. Language skills and question length should be taken into account when setting time limits for examination.
Karl
M
M
Department of Prosthodontics, University of Erlangen-Nuremberg, Erlangen, Germany. karl_matthias@web.de
Graef
F
F
Eitner
S
S
Beck
N
N
Wichmann
M
M
Holst
S
S
D003194:Computer-Assisted Instruction; D004497:Education, Dental; D004521:Educational Measurement / Q000379:methods*; D005858:Germany; D006801:Humans; D014584:User-Computer Interface