title: A new impact assessment method to evaluate knowledge resources.
abstract: BACKGROUND
  Methods to systematically measure the impact of knowledge resources on health professionals would enhance evaluation of these resources in the real world.
  
  
  OBJECTIVE
  To propose a new impact assessment method.
  
  
  BACKGROUND
  We demonstrated the feasibility of combining a 4-level scale with Computerized Ecological Momentary Assessment (CEMA) for efficiently measuring the impact of a knowledge resource.
  
  
  METHODS
  We critically reviewed the world literature regarding the impact of clinical information-retrieval technology on trainees and doctors, and retained 26 papers for qualitative content analysis.
  
  
  RESULTS
  Of those, 21 use a nominal scale (yes/no), none systematically measures the impact of searches for information outside of a laboratory setting, and none uses an ordinal scale. The literature supports the proposed levels of impact, and suggests a fifth level.
  
  
  CONCLUSIONS
  A new impact assessment method is proposed, which combines a 5-level revised scale and CEMA.
authors.affiliation: Department of Social Studies of Medicine, McGill University, 3647 Peel Street, Montreal, QC, Canada, H3A 1X1.
authors.forename: Pierre
authors.initials: P
authors.lastname: Pluye
authors.forename: Roland M
authors.initials: RM
authors.lastname: Grad
authors.forename: Randolph
authors.initials: R
authors.lastname: Stephenson
authors.forename: Lynn G
authors.initials: LG
authors.lastname: Dunikowski
mesh_terms: D019992:Databases as Topic; D005069:Evaluation Studies as Topic; D005240:Feasibility Studies; D016247:Information Storage and Retrieval; D007256:Information Systems; D013782:Textbooks as Topic