title: Evaluation of KNAVE-II: a tool for intelligent query and exploration of patient data.
abstract: We present the results of a preliminary evaluation of KNAVE-II, a distributed knowledge-based computational framework for visualization, interpretation, and exploration of longitudinal clinical data and of multiple levels of concepts derivable from these data. KNAVE-II uses a distributed architecture to access at run-time clinical time-oriented data, a domain-specific knowledge base containing properties of the clinical data, and a knowledge-based problem-solving method for computing on-the-fly interpretations of these data. The purpose of the evaluation was to compare efficiency and user satisfaction when answering clinical queries of variable complexity about clinical time-oriented data using KNAVE-II, versus using methods available in standard clinical settings: paper chart or electronic spreadsheet (ESS). Subjects answered high-complexity queries significantly faster using KNAVE-II than when using paper or ESS. User satisfaction with KNAVE-II was significantly superior compared to satisfaction using paper or ESS, based on a standard usability scale. Users also explicitly ranked KNAVE-II as superior to paper and the ESS.
authors.affiliation: Center for Primary Care and Outcomes Research, Stanford University School of Medicine, Stanford, CA, USA.
authors.forename: Susana B
authors.initials: SB
authors.lastname: Martins
authors.forename: Yuval
authors.initials: Y
authors.lastname: Shahar
authors.forename: Maya
authors.initials: M
authors.lastname: Galperin
authors.forename: Herbert
authors.initials: H
authors.lastname: Kaizer
authors.forename: Dina
authors.initials: D
authors.lastname: Goren-Bar
authors.forename: Deborah
authors.initials: D
authors.lastname: McNaughton
authors.forename: Lawrence V
authors.initials: LV
authors.lastname: Basso
authors.forename: Mary K
authors.initials: MK
authors.lastname: Goldstein
mesh_terms: D001185:Artificial Intelligence; D003195:Computer Communication Networks; D003258:Consumer Behavior; D018592:Cross-Over Studies; D020000:Decision Support Systems, Clinical; D006801:Humans; D008491:Medical Informatics Applications; D016347:Medical Records Systems, Computerized; D012984:Software; D014584:User-Computer Interface