Validity of cluster headache diagnoses in an electronic health record data repository.
BACKGROUND
Cluster headache (CH) is uncommon, so electronic searches of large medical record databases provide an important opportunity to identify a sufficient number of patients for research, patient registries, or quality improvement work. However, the accuracy of CH diagnoses recorded in electronic health record (EHR) databases is unknown. The Research Patient Data Registry (RPDR) warehouses information from EHR of two academic medical centers in Boston. We assessed the validity of CH diagnoses in the RPDR as well as the sensitivity of International Classification of Headache Disorders (ICHD) diagnostic criteria in relation to the gold standard of expert clinician diagnosis of CH.


METHODS
In 2013, we queried RPDR to identify all patients diagnosed with CH diagnosed by headache specialists from 2002 to 2012. We sought to determine the positive predictive value (PPV) of an EHR diagnosis of CH relative to a headache expert's clinical impression as the gold standard. We also calculated the sensitivity of ICHD-2 CH criteria compared with the gold standard of expert-diagnosed CH cases.


RESULTS
RPDR queries identified 170 patients with a diagnosis of CH. Two researchers carried out a detailed chart review searching for information to support or refute this diagnosis. In 58 cases, the diagnosis of CH was determined to be inaccurate due to data entry errors. The PPV of an RPDR diagnosis of CH was 63% (95% CI 54-71%) and the sensitivity of ICHD-2 criteria compared with the gold standard of expert diagnosis was 77% (95% CI 69-82%).


CONCLUSIONS
The PPV of EHR diagnoses of CH is modest. Data entry errors are common, and only about three-fourths of CH cases diagnosed by expert clinicians meet ICHD criteria for CH. Thus, EHR searches for patients with CH frequently will result in false positives. This has implications for activities such as research, quality improvement efforts, or disease registries that rely on EHR searches to identify patients. Further work is needed to develop high quality phenotypic algorithms so that the research potential of EHRs can be realized.
Harvard Medical School, Boston, MA, USA (P. Rizzoli, E. Loder).|Graham Headache Center, Brigham and Women's and Brigham and Women's Faulkner Hospitals, Boston, MA, USA (P. Rizzoli).
Paul
P
Rizzoli
Harvard Medical School, Boston, MA, USA (P. Rizzoli, E. Loder).|Division of Headache, Department of Neurology, Brigham and Women's and Brigham and Women's Faulkner Hospitals, Boston, MA, USA (E. Loder).
Elizabeth
E
Loder
MCPHS University College of Pharmacy, Boston, MA, USA (S. Joshi).|Community Neuroscience Services, Westborough, MA, USA (S. Joshi).
Shivang
S
Joshi
D000046:Academic Medical Centers; D001900:Boston; D003027:Cluster Headache / Q000175:diagnosis*; D016208:Databases, Factual; D003951:Diagnostic Errors; D057286:Electronic Health Records / Q000592:standards; D005189:False Positive Reactions; D006801:Humans; D012042:Registries; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity
cluster headache; electronic health record; phenotype algorithm; positive predictive value; sensitivity