title: Visions and strategies to improve evaluation of health information systems. Reflections and lessons based on the HIS-EVAL workshop in Innsbruck.
abstract: BACKGROUND
  Health care is entering the Information Society. It is evident that the use of modern information and communication technology offers tremendous opportunities to improve health care. However, there are also hazards associated with information technology in health care. Evaluation is a means to assess the quality, value, effects and impacts of information technology and applications in the health care environment, to improve health information applications and to enable the emergence of an evidence-based health informatics profession and practice.
  
  
  OBJECTIVE
  In order to identify and address the frequent problems of getting evaluation understood and recognised, to promote transdisciplinary exchange within evaluation research, and to promote European cooperation, the Exploratory Workshop on "New Approaches to the Systematic Evaluation of Health Information Systems" (HIS-EVAL) was organized by the University for Health Sciences, Medical Informatics and Technology (UMIT), Innsbruck, Austria, in April 2003 with sponsorship from the European Science Foundation (ESF).
  
  
  METHODS
  The overall program was structured in three main parts: (a). discussion of problems and barriers to evaluation; (b). defining our visions and strategies with regard to evaluation of health information systems; and (c). organizing short-term and long-term activities to reach those visions and strategies.
  
  
  RESULTS
  The workshop participants agreed on the Declaration of Innsbruck (see ), comprising four observations and 12 recommendations with regard to evaluation of health information systems. Future activities comprise European networking as well as the development of guidelines and standards for evaluation studies.
  
  
  CONCLUSIONS
  The HIS-EVAL workshop was intended to be the starting point for setting up a network of European scientists working on evaluation of health information systems, to obtain synergy effects by combining the research traditions from different evaluation fields, leading to a new dimension and collaboration on further research on information systems' evaluation.
authors.affiliation: University for Health Sciences, Medical Informatics and Technology (UMIT), Research Group Assessment of Health Information Systems, Innrain 98, 6020 Innsbruck, Austria. elske.ammenwerth@umit.at
authors.forename: Elske
authors.initials: E
authors.lastname: Ammenwerth
authors.forename: Jytte
authors.initials: J
authors.lastname: Brender
authors.forename: Pirkko
authors.initials: P
authors.lastname: Nykänen
authors.forename: Hans-Ulrich
authors.initials: HU
authors.lastname: Prokosch
authors.forename: Michael
authors.initials: M
authors.lastname: Rigby
authors.forename: Jan
authors.initials: J
authors.lastname: Talmon
mesh_terms: D004493:Education; D005060:Europe; D005069:Evaluation Studies as Topic; D007256:Information Systems / Q000592:standards*; D011786:Quality Control