SYRIAC: The systematic review information automated collection system a data warehouse for facilitating automated biomedical text classification.
Automatic document classification can be valuable in increasing the efficiency in updating systematic reviews (SR). In order for the machine learning process to work well, it is critical to create and maintain high-quality training datasets consisting of expert SR inclusion/exclusion decisions. This task can be laborious, especially when the number of topics is large and source data format is inconsistent.To approach this problem, we build an automated system to streamline the required steps, from initial notification of update in source annotation files to loading the data warehouse, along with a web interface to monitor the status of each topic. In our current collection of 26 SR topics, we were able to standardize almost all of the relevance judgments and recovered PMIDs for over 80% of all articles. Of those PMIDs, over 99% were correct in a manual random sample study. Our system performs an essential function in creating training and evaluation data sets for SR text mining research.
Yang
Jianji J
JJ
Portland Center for the Evaluation of Clinical Services, Portland VA Medical Center, USA.
Cohen
Aaron M
AM
Cohen
Aaron
A
McDonagh
Marian S
MS
D000043:Abstracting and Indexing / Q000379:methods; D000465:Algorithms; D001185:Artificial Intelligence; D016208:Databases, Factual; D009323:Natural Language Processing; D010363:Pattern Recognition, Automated / Q000379:methods; D010506:Periodicals as Topic / Q000145:classification; D039781:PubMed / Q000145:classification; D009626:Terminology as Topic; D014481:United States; D000078202:Systematic Reviews as Topic