title: Beyond relevance and recall: testing new user-centred measures of database performance.
abstract: BACKGROUND
  Measures of the effectiveness of databases have traditionally focused on recall, precision, with some debate on how relevance can be assessed, and by whom. New measures of database performance are required when users are familiar with search engines, and expect full text availability.
  
  
  OBJECTIVE
  This research ascertained which of four bibliographic databases (BNI, CINAHL, MEDLINE and EMBASE) could be considered most useful to nursing and midwifery students searching for information for an undergraduate dissertation.
  
  
  METHODS
  Searches on title were performed for dissertation topics supplied by nursing students (n = 9), who made the relevance judgements. Measures of recall and precision were combined with additional factors to provide measures of effectiveness, while efficiency combined measures of novelty and originality and accessibility combined measures for availability and retrievability, based on obtainability.
  
  
  RESULTS
  There were significant differences among the databases in precision, originality and availability, but other differences were not significant (Friedman test). Odds ratio tests indicated that BNI, followed by CINAHL were the most effective, CINAHL the most efficient, and BNI the most accessible.
  
  
  CONCLUSIONS
  The methodology could help library services in purchase decisions as the measure for accessibility, and odds ratio testing helped to differentiate database performance.
authors.affiliation: Anglia Ruskin University, Education Centre, Peterborough District Hospital, UK. peter.stokes@anglia.ac.uk
authors.forename: Peter
authors.initials: P
authors.lastname: Stokes
authors.forename: Allen
authors.initials: A
authors.lastname: Foster
authors.forename: Christine
authors.initials: C
authors.lastname: Urquhart
mesh_terms: D000043:Abstracting and Indexing / Q000706:statistics & numerical data*; D016206:Databases, Bibliographic / Q000706:statistics & numerical data*; D004508:Education, Nursing, Baccalaureate / Q000379:methods*; D006801:Humans; D016247:Information Storage and Retrieval / Q000379:methods*; D016017:Odds Ratio; D010506:Periodicals as Topic / Q000706:statistics & numerical data*; D013338:Students, Nursing; D006113:United Kingdom