title: Evaluation in the design of health information systems: application of approaches emerging from usability engineering.
abstract: This paper examines the role of evaluation in the design of health care information systems. A framework is presented for considering evaluation in the context of software development processes, in particular, the systems development life cycle (SDLC). Variations on standard design methodologies are then discussed, including methods based on rapid development and continual evaluation of prototype systems. Usability testing is presented as a key method for conducting evaluations during iterative system development. The emergence of design methodologies, where evaluation is viewed as a central part of the development cycle is also discussed. Evaluation methodologies are then considered along a continuum, ranging from studies involving a high degree of experimental control to observational approaches. A full cycle approach to evaluation of health care systems is argued for, involving deployment of new methods across the SDLC. Implications for future work exploring the integration of design and evaluation processes in health informatics are discussed.
authors.affiliation: Department of Mathematics and Statistics, Information Technology Division, York University, 4700 Keele St., Toronto, Ont., Canada M3J 1P3. andrek@mathstat.yorku.ca
authors.forename: Andre
authors.initials: A
authors.lastname: Kushniruk
mesh_terms: D001698:Biomedical Engineering; D004867:Equipment Design; D005069:Evaluation Studies as Topic; D005544:Forecasting; D008490:Medical Informatics / Q000592:standards*; D013673:Technology Assessment, Biomedical