title: Open-book tests: search behaviour, time used and test scores.
abstract: BACKGROUND
  Because of the increasing medical knowledge and the focus of medical education on acquiring competencies, the use of open-book tests seems inevitable. Dealing with a large body of information, indicating which kind of information is needed to solve a problem, and finding and understanding that knowledge at the right moment are behaviours that cannot be assessed during closed-book tests.
  
  
  OBJECTIVE
  To examine whether there is a relationship between students' search behaviour - using references or not when answering a question - during open-book tests and their test scores.
  
  
  METHODS
  Second- (N = 491) and third-year medical students (N = 325) participated in this study. Search behaviour was operationalized as the number of questions for which students consulted their references. Furthermore, we collected data on the time students spent on answering all open-book questions and their test scores. To determine the relations, we calculated Spearman's and Pearson's correlations.
  
  
  RESULTS
  Second- and third-year students consulted their references for 87% and 73% of the questions and spent 5.0 and 4.3 min on answering an open-book question, respectively. We did not find significant correlations between search behaviour and test scores.
  
  
  CONCLUSIONS
  Both 'well' and 'poorer performing' students often consulted their references. Spending almost 5 min per open-book question in multiple choice format seems to be too much. More research is needed to establish optimal open-book test time and to explore how 'well performing' students use their references during open-book tests.
authors: University of Groningen, the Netherlands.
authors: Andrie C
authors: AC
authors: Westerkamp
authors: Marjolein
authors: M
authors: Heijne-Penninga
authors: Jan B M
authors: JB
authors: Kuks
authors: Janke
authors: J
authors: Cohen-Schotanus
mesh_terms: D004504:Education, Medical, Undergraduate; D004521:Educational Measurement / Q000379:methods*; D005260:Female; D006801:Humans; D008297:Male; D013782:Textbooks as Topic; D013997:Time Factors; D055815:Young Adult