Design and validation of a questionnaire to evaluate the usability of computerized critical care information systems.
The implementation of computerized critical care information systems (CCIS) can improve the quality of clinical care and staff satisfaction, but also holds risks of disrupting the workflow with consecutive negative impacts. The usability of CCIS is one of the key factors determining their benefits and weaknesses. However, no tailored instrument exists to measure the usability of such systems. Therefore, the aim of this study was to design and validate a questionnaire that measures the usability of CCIS. Following a mixed-method design approach, we developed a questionnaire comprising two evaluation models to assess the usability of CCIS: (1) the task-specific model rates the usability individually for several tasks which CCIS could support and which we derived by analyzing work processes in the ICU; (2) the characteristic-specific model rates the different aspects of the usability, as defined by the international standard "ergonomics of human-system interaction". We tested validity and reliability of the digital version of the questionnaire in a sample population. In the sample population of 535 participants both usability evaluation models showed a strong correlation with the overall rating of the system (multiple correlation coefficients ≥0.80) as well as a very high internal consistency (Cronbach's alpha ≥0.93). The novel questionnaire is a valid and reliable instrument to measure the usability of CCIS and can be used to study the influence of the usability on their implementation benefits and weaknesses.
Klinik für Anästhesiologie mit Schwerpunkt operative Intensivmedizin, Charité - Universitätsmedizin Berlin, Campus Charité Mitte und Campus Virchow-Klinikum, Augustenburger Platz 1, 13353, Berlin, Germany. falk.von-dincklage@charite.de.
Falk
F
von Dincklage
Klinik für Anästhesiologie mit Schwerpunkt operative Intensivmedizin, Charité - Universitätsmedizin Berlin, Campus Charité Mitte und Campus Virchow-Klinikum, Augustenburger Platz 1, 13353, Berlin, Germany.
Gregor
G
Lichtner
Klinik für Anästhesiologie und Intensivmedizin, Medizinische Hochschule Hannover, Hannover, Germany.
Klaudiusz
K
Suchodolski
Klinik und Poliklinik für Anästhesiologie und Intensivtherapie, Technische Universität Dresden, Universitätsklinikum Carl Gustav Carus, Dresden, Germany.
Maximilian
M
Ragaller
HCMB Institute for Health Care Systems Management Berlin eG, Berlin, Germany.
Wolfgang
W
Friesdorf
Clinical Excellence Research Center, Stanford University, Stanford, CA, USA.
Beatrice
B
Podtschaske
D000328:Adult; D001291:Attitude of Health Personnel; D003199:Computer Systems; D003201:Computers; D003422:Critical Care; D004867:Equipment Design; D005260:Female; D006751:Hospital Information Systems; D006801:Humans; D007362:Intensive Care Units; D008297:Male; D008875:Middle Aged; D008991:Monitoring, Physiologic; D010043:Outcome and Process Assessment, Health Care; D015397:Program Evaluation; D015203:Reproducibility of Results; D012107:Research Design; D012984:Software; D011795:Surveys and Questionnaires; D014584:User-Computer Interface
Critical care; Information system; Usability; Work process analysis