title: Portability of an algorithm to identify rheumatoid arthritis in electronic health records.
abstract: OBJECTIVE
  Electronic health records (EHR) can allow for the generation of large cohorts of individuals with given diseases for clinical and genomic research. A rate-limiting step is the development of electronic phenotype selection algorithms to find such cohorts. This study evaluated the portability of a published phenotype algorithm to identify rheumatoid arthritis (RA) patients from EHR records at three institutions with different EHR systems.
  
  
  METHODS
  Physicians reviewed charts from three institutions to identify patients with RA. Each institution compiled attributes from various sources in the EHR, including codified data and clinical narratives, which were searched using one of two natural language processing (NLP) systems. The performance of the published model was compared with locally retrained models.
  
  
  RESULTS
  Applying the previously published model from Partners Healthcare to datasets from Northwestern and Vanderbilt Universities, the area under the receiver operating characteristic curve was found to be 92% for Northwestern and 95% for Vanderbilt, compared with 97% at Partners. Retraining the model improved the average sensitivity at a specificity of 97% to 72% from the original 65%. Both the original logistic regression models and locally retrained models were superior to simple billing code count thresholds.
  
  
  CONCLUSIONS
  These results show that a previously published algorithm for RA is portable to two external hospitals using different EHR systems, different NLP systems, and different target NLP vocabularies. Retraining the algorithm primarily increased the sensitivity at each site.
  
  
  CONCLUSIONS
  Electronic phenotype algorithms allow rapid identification of case populations in multiple sites with little retraining.
authors.affiliation: Department of Biomedical Informatics, Vanderbilt University School of Medicine, Nashville, Tennessee 37232, USA.
authors.forename: Robert J
authors.initials: RJ
authors.lastname: Carroll
authors.forename: Will K
authors.initials: WK
authors.lastname: Thompson
authors.forename: Anne E
authors.initials: AE
authors.lastname: Eyler
authors.forename: Arthur M
authors.initials: AM
authors.lastname: Mandelin
authors.forename: Tianxi
authors.initials: T
authors.lastname: Cai
authors.forename: Raquel M
authors.initials: RM
authors.lastname: Zink
authors.forename: Jennifer A
authors.initials: JA
authors.lastname: Pacheco
authors.forename: Chad S
authors.initials: CS
authors.lastname: Boomershine
authors.forename: Thomas A
authors.initials: TA
authors.lastname: Lasko
authors.forename: Hua
authors.initials: H
authors.lastname: Xu
authors.forename: Elizabeth W
authors.initials: EW
authors.lastname: Karlson
authors.forename: Raul G
authors.initials: RG
authors.lastname: Perez
authors.forename: Vivian S
authors.initials: VS
authors.lastname: Gainer
authors.forename: Shawn N
authors.initials: SN
authors.lastname: Murphy
authors.forename: Eric M
authors.initials: EM
authors.lastname: Ruderman
authors.forename: Richard M
authors.initials: RM
authors.lastname: Pope
authors.forename: Robert M
authors.initials: RM
authors.lastname: Plenge
authors.forename: Abel Ngo
authors.initials: AN
authors.lastname: Kho
authors.forename: Katherine P
authors.initials: KP
authors.lastname: Liao
authors.forename: Joshua C
authors.initials: JC
authors.lastname: Denny
mesh_terms: D000465:Algorithms; D001172:Arthritis, Rheumatoid; D057286:Electronic Health Records; D006751:Hospital Information Systems; D006785:Hospitals, University; D006801:Humans; D009323:Natural Language Processing; D012372:ROC Curve