title: Cognitive impact assessment of electronic knowledge resources: a mixed methods evaluation study of a handheld prototype.
abstract: BACKGROUND
  We recently proposed a new method to systematically assess the cognitive impact of knowledge resources on health professionals.
  
  
  OBJECTIVE
  To describe promises and shortcomings of a handheld computer prototype of this method.
  
  
  BACKGROUND
  We developed an impact scale, and combined this scale with a Computerized Ecological Momentary Assessment technique.
  
  
  METHODS
  We conducted a mixed methods evaluation study using a 7-item scale within a questionnaire linked to a commercial knowledge resource. Over two months of Family Medicine training, 17 residents assessed the impact of 1,981 information hits retrieved on handheld computer. From observations, log-reports, archives of hits and interviews, we examined issues associated with hardware, software and the questionnaire.
  
  
  RESULTS
  Fifteen residents found the questionnaire clearly written, and only one pointed to the questionnaire as a major reason for their low level of use of the resource. Residents reported technical problems (e.g. screen trouble) or limitations (e.g. limited tracking function) and socio-technical issues (e.g. software dependency).
  
  
  CONCLUSIONS
  Lessons from this study suggest improvements to guide future implementation of our method for assessing the cognitive impact of knowledge resources on health professionals.
authors.affiliation: Department of Family Medicine, McGill University, 517 Pine Avenue West, Montreal, Quebec, Canada, H2W 1S4.
authors.forename: Pierre
authors.initials: P
authors.lastname: Pluye
authors.forename: Roland M
authors.initials: RM
authors.lastname: Grad
mesh_terms: D001292:Attitude to Computers; D003071:Cognition; D034201:Computers, Handheld; D003258:Consumer Behavior; D019992:Databases as Topic; D004868:Equipment Failure; D005194:Family Practice / Q000193:education; D006801:Humans; D016247:Information Storage and Retrieval; D007396:Internship and Residency; D008137:Longitudinal Studies; D012984:Software; D011795:Surveys and Questionnaires