Offline testing of the ATHENA Hypertension decision support system knowledge base to improve the accuracy of recommendations.
ATHENA-HTN is a clinical decision support system (CDSS) that delivers guideline-based patient-specific recommendations about hypertension management at the time of clinical decision-making. The ATHENA-HTN knowledge is stored in a knowledge-base (KB). Changes in best-practice recommendations require updates to the KB. We describe a method of offline testing to evaluate the accuracy of recommendations generated from the KB. A physician reviewed 100 test cases and made drug recommendations based on guidelines and the "Rules" (descriptions of encoded knowledge). These drug recommendations were compared to those generated by ATHENA-HTN. Nineteen drug-recommendation discrepancies were identified: ATHENA-HTN was more complete in generating recommendations (15); ambiguities in the Rules misled the physician (3); and content in the Rules was not encoded (1). Three new boundaries were identified. Three updates were made to the KB based on the results. The offline testing method was successful in identifying areas for KB improvement and led to improved accuracy of guideline-based recommendations.
Martins
S B
SB
GRECC, VA Palo Alto Health Care System, Palo Alto, CA, USA.
Lai
S
S
Tu
S
S
Shankar
R
R
Hastings
S N
SN
Hoffman
B B
BB
Dipilla
N
N
Goldstein
M K
MK
D000959:Antihypertensive Agents / Q000627:therapeutic use; D020000:Decision Support Systems, Clinical; D004360:Drug Therapy, Computer-Assisted; D006801:Humans; D006973:Hypertension / Q000188:drug therapy*; D051188:Knowledge Bases; D017410:Practice Guidelines as Topic; D014584:User-Computer Interface
D000959:Antihypertensive Agents