title: Natural language processing for the development of a clinical registry: a validation study in intraductal papillary mucinous neoplasms.
abstract: BACKGROUND
  Medical natural language processing (NLP) systems have been developed to identify, extract and encode information within clinical narrative text. However, the role of NLP in clinical research and patient care remains limited. Pancreatic cysts are common. Some pancreatic cysts, such as intraductal papillary mucinous neoplasms (IPMNs), have malignant potential and require extended periods of surveillance. We seek to develop a novel NLP system that could be applied in our clinical network to develop a functional registry of IPMN patients.
  
  
  OBJECTIVE
  This study aims to validate the accuracy of our novel NLP system in the identification of surgical patients with pathologically confirmed IPMN in comparison with our pre-existing manually created surgical database (standard reference).
  
  
  METHODS
  The Regenstrief EXtraction Tool (REX) was used to extract pancreatic cyst patient data from medical text files from Indiana University Health. The system was assessed periodically by direct sampling and review of medical records. Results were compared with the standard reference.
  
  
  RESULTS
  Natural language processing detected 5694 unique patients with pancreas cysts, in 215 of whom surgical pathology had confirmed IPMN. The NLP software identified all but seven patients present in the surgical database and identified an additional 37 IPMN patients not previously included in the surgical database. Using the standard reference, the sensitivity of the NLP program was 97.5% (95% confidence interval [CI] 94.8-98.9%) and its positive predictive value was 95.5% (95% CI 92.3-97.5%).
  
  
  CONCLUSIONS
  Natural language processing is a reliable and accurate method for identifying selected patient cohorts and may facilitate the identification and follow-up of patients with IPMN.
authors.affiliation: Department of Medicine, Indiana University School of Medicine, Indianapolis, IN, USA.
authors.forename: Mohammad A
authors.initials: MA
authors.lastname: Al-Haddad
authors.forename: Jeff
authors.initials: J
authors.lastname: Friedlin
authors.forename: Joe
authors.initials: J
authors.lastname: Kesterson
authors.forename: Joshua A
authors.initials: JA
authors.lastname: Waters
authors.forename: Juan R
authors.initials: JR
authors.lastname: Aguilar-Saavedra
authors.forename: C Max
authors.initials: CM
authors.lastname: Schmidt
mesh_terms: D021441:Carcinoma, Pancreatic Ductal / Q000473:pathology* / Q000601:surgery; D002291:Carcinoma, Papillary / Q000473:pathology* / Q000601:surgery; D057225:Data Mining; D018450:Disease Progression; D006801:Humans; D007196:Indiana; D009323:Natural Language Processing; D018297:Neoplasms, Cystic, Mucinous, and Serous / Q000473:pathology* / Q000601:surgery; D010181:Pancreatic Cyst / Q000473:pathology* / Q000601:surgery; D010190:Pancreatic Neoplasms / Q000473:pathology* / Q000601:surgery; D011230:Precancerous Conditions / Q000473:pathology* / Q000601:surgery; D011379:Prognosis; D012042:Registries; D015203:Reproducibility of Results; D012984:Software; D013997:Time Factors