Cognitive impact assessment of electronic knowledge resources: a mixed methods evaluation study of a handheld prototype.
BACKGROUND
We recently proposed a new method to systematically assess the cognitive impact of knowledge resources on health professionals.


OBJECTIVE
To describe promises and shortcomings of a handheld computer prototype of this method.


BACKGROUND
We developed an impact scale, and combined this scale with a Computerized Ecological Momentary Assessment technique.


METHODS
We conducted a mixed methods evaluation study using a 7-item scale within a questionnaire linked to a commercial knowledge resource. Over two months of Family Medicine training, 17 residents assessed the impact of 1,981 information hits retrieved on handheld computer. From observations, log-reports, archives of hits and interviews, we examined issues associated with hardware, software and the questionnaire.


RESULTS
Fifteen residents found the questionnaire clearly written, and only one pointed to the questionnaire as a major reason for their low level of use of the resource. Residents reported technical problems (e.g. screen trouble) or limitations (e.g. limited tracking function) and socio-technical issues (e.g. software dependency).


CONCLUSIONS
Lessons from this study suggest improvements to guide future implementation of our method for assessing the cognitive impact of knowledge resources on health professionals.
Pluye
Pierre
P
Department of Family Medicine, McGill University, 517 Pine Avenue West, Montreal, Quebec, Canada, H2W 1S4.
Grad
Roland M
RM
D001292:Attitude to Computers; D003071:Cognition; D034201:Computers, Handheld; D003258:Consumer Behavior; D019992:Databases as Topic; D004868:Equipment Failure; D005194:Family Practice / Q000193:education; D006801:Humans; D016247:Information Storage and Retrieval; D007396:Internship and Residency; D008137:Longitudinal Studies; D012984:Software; D011795:Surveys and Questionnaires