title: A human-computer collaborative approach to identifying common data elements in clinical trial eligibility criteria.
abstract: OBJECTIVE
  To identify Common Data Elements (CDEs) in eligibility criteria of multiple clinical trials studying the same disease using a human-computer collaborative approach.
  
  
  METHODS
  A set of free-text eligibility criteria from clinical trials on two representative diseases, breast cancer and cardiovascular diseases, was sampled to identify disease-specific eligibility criteria CDEs. In this proposed approach, a semantic annotator is used to recognize Unified Medical Language Systems (UMLSs) terms within the eligibility criteria text. The Apriori algorithm is applied to mine frequent disease-specific UMLS terms, which are then filtered by a list of preferred UMLS semantic types, grouped by similarity based on the Dice coefficient, and, finally, manually reviewed.
  
  
  METHODS
  Standard precision, recall, and F-score of the CDEs recommended by the proposed approach were measured with respect to manually identified CDEs.
  
  
  RESULTS
  Average precision and recall of the recommended CDEs for the two diseases were 0.823 and 0.797, respectively, leading to an average F-score of 0.810. In addition, the machine-powered CDEs covered 80% of the cardiovascular CDEs published by The American Heart Association and assigned by human experts.
  
  
  CONCLUSIONS
  It is feasible and effort saving to use a human-computer collaborative approach to augment domain experts for identifying disease-specific CDEs from free-text clinical trial eligibility criteria.
authors: Department of Biomedical Informatics, Columbia University, New York, NY 10032, United States.
authors: Zhihui
authors: Z
authors: Luo
authors: Riccardo
authors: R
authors: Miotto
authors: Chunhua
authors: C
authors: Weng
mesh_terms: D000465:Algorithms; D002986:Clinical Trials as Topic; D003299:Cooperative Behavior; D006801:Humans; D016247:Information Storage and Retrieval; D008328:Man-Machine Systems; D018579:Patient Selection; D017432:Unified Medical Language System