Intraclass correlation metrics for the accuracy of algorithmic definitions in a computerized decision support system for supportive cancer care.
As part of the development of a computerized clinical decision support system for anemia management in cancer patients, we applied psychometric principles and techniques to assess the accuracy of the algorithmic operationalizations of a set of evidence-based practice guidelines. In an iterative rating process, five medical and nursing experts rated 27 algorithmic sets derived from 18 guidelines, the objective being an intraclass coefficient (ICC) exceeding 0.90. The first round of review yielded an ICC of 1.00 for 22 sets. After revision and resubmission to the expert panel, an ICC of 1.00 was obtained for the additional five sets. The evolving decision support system is based on algorithms that accurately specify evidence-based guidelines for anemia management in cancer patients.
Aapro
Matti
M
Institut Multidisciplinaire d'Oncology, Clinique de Genolier, 1 Route du Muids, CH-1272, Genolier, Switzerland.
Abraham
Ivo
I
Matrix45, 620 Frays Ridge Road, Earlysville, VA, 22936, USA. iabraham@matrix45.com.|Center for Health Outcomes and Policy Research, Leonard Davis Institute of Health Economics and Institute of Aging, University of Pennsylvania, 418 Curie Boulevard, Philadelphia, PA, 19104, USA. iabraham@matrix45.com.
MacDonald
Karen
K
Matrix45, 620 Frays Ridge Road, Earlysville, VA, 22936, USA.
Soubeyran
Pierre
P
Institut Bergonié, 229, cours de l'Argonne and Université Victor Segalen Bordeaux 2, 146 rue Léo Saignat, 33076, Bordeaux, France.
Foubert
Jan
J
Erasmushogeschool, Laarbeeklaan 101, B-1090, Brussel, Belgium.
Bokemeyer
Carsten
C
Universitätsklinikum Hamburg Eppendorf, Martinistraße 52, 20246, Hamburg, Germany.
Muenzberg
Michael
M
F. Hoffmann-La Roche AG, Grenzacherstrasse, Bau 74, CH-4070, Basel, Switzerland.
Van Erps
Joanna
J
Afdeling Oncologie en Hematologie, Algemeen Stedelijk Ziekenhuis Aalst, Merestraat 80, B-9300, Aalst, Belgium.
Turner
Matthew
M
Roche Products, 6 Falcon Way, Shire Park, Welwyn Garden City, AL7 1TW, Hertfordshire, UK.
D000465:Algorithms; D003201:Computers; D020000:Decision Support Systems, Clinical / Q000706:statistics & numerical data; D006801:Humans; D009369:Neoplasms / Q000628:therapy*; D011594:Psychometrics; D015203:Reproducibility of Results