title: Evaluation of an Automated Information Extraction Tool for Imaging Data Elements to Populate a Breast Cancer Screening Registry.
abstract: Breast cancer screening is central to early breast cancer detection. Identifying and monitoring process measures for screening is a focus of the National Cancer Institute's Population-based Research Optimizing Screening through Personalized Regimens (PROSPR) initiative, which requires participating centers to report structured data across the cancer screening continuum. We evaluate the accuracy of automated information extraction of imaging findings from radiology reports, which are available as unstructured text. We present prevalence estimates of imaging findings for breast imaging received by women who obtained care in a primary care network participating in PROSPR (n = 139,953 radiology reports) and compared automatically extracted data elements to a "gold standard" based on manual review for a validation sample of 941 randomly selected radiology reports, including mammograms, digital breast tomosynthesis, ultrasound, and magnetic resonance imaging (MRI). The prevalence of imaging findings vary by data element and modality (e.g., suspicious calcification noted in 2.6% of screening mammograms, 12.1% of diagnostic mammograms, and 9.4% of tomosynthesis exams). In the validation sample, the accuracy of identifying imaging findings, including suspicious calcifications, masses, and architectural distortion (on mammogram and tomosynthesis); masses, cysts, non-mass enhancement, and enhancing foci (on MRI); and masses and cysts (on ultrasound), range from 0.8 to1.0 for recall, precision, and F-measure. Information extraction tools can be used for accurate documentation of imaging findings as structured data elements from text reports for a variety of breast imaging modalities. These data can be used to populate screening registries to help elucidate more effective breast cancer screening processes.
authors.affiliation: Department of Radiology, Brigham and Women's Hospital, 75 Francis Street, Boston, MA, 02115, USA. rlacson@partners.org.|Harvard Medical School, Boston, MA, USA. rlacson@partners.org.
authors.forename: Ronilda
authors.initials: R
authors.lastname: Lacson
authors.affiliation: Department of General Internal Medicine and Primary Care, Brigham and Women's Hospital, Boston, MA, USA.
authors.forename: Kimberly
authors.initials: K
authors.lastname: Harris
authors.affiliation: Department of General Internal Medicine and Primary Care, Brigham and Women's Hospital, Boston, MA, USA.
authors.forename: Phyllis
authors.initials: P
authors.lastname: Brawarsky
authors.affiliation: Department of Community and Family Medicine, The Dartmouth Institute for Health Policy and Clinical Practice, Lebanon, NH, USA.
authors.forename: Tor D
authors.initials: TD
authors.lastname: Tosteson
authors.affiliation: Department of Community and Family Medicine, The Dartmouth Institute for Health Policy and Clinical Practice, Lebanon, NH, USA.
authors.forename: Tracy
authors.initials: T
authors.lastname: Onega
authors.affiliation: Department of Community and Family Medicine, The Dartmouth Institute for Health Policy and Clinical Practice, Lebanon, NH, USA.|Department of Medicine, The Dartmouth Institute for Health Policy and Clinical Practice, Lebanon, NH, USA.
authors.forename: Anna N A
authors.initials: AN
authors.lastname: Tosteson
authors.affiliation: Department of General Internal Medicine and Primary Care, Brigham and Women's Hospital, Boston, MA, USA.
authors.forename: Abby
authors.initials: A
authors.lastname: Kaye
authors.affiliation: Department of General Internal Medicine and Primary Care, Brigham and Women's Hospital, Boston, MA, USA.
authors.forename: Irina
authors.initials: I
authors.lastname: Gonzalez
authors.affiliation: Department of Radiology, Brigham and Women's Hospital, 75 Francis Street, Boston, MA, 02115, USA.|Harvard Medical School, Boston, MA, USA.
authors.forename: Robyn
authors.initials: R
authors.lastname: Birdwell
authors.affiliation: Department of General Internal Medicine and Primary Care, Brigham and Women's Hospital, Boston, MA, USA.|Harvard Medical School, Boston, MA, USA.
authors.forename: Jennifer S
authors.initials: JS
authors.lastname: Haas
mesh_terms: D001943:Breast Neoplasms / Q000000981:diagnostic imaging*; D055088:Early Detection of Cancer; D005260:Female; D006801:Humans; D016247:Information Storage and Retrieval / Q000379:methods*; D008327:Mammography; D011873:Radiology Information Systems; D012042:Registries; D015203:Reproducibility of Results
keywords: BI-RADS; Breast; Data extraction; Information storage and retrieval; Natural language processing