title: ODMSummary: A Tool for Automatic Structured Comparison of Multiple Medical Forms Based on Semantic Annotation with the Unified Medical Language System.
abstract: BACKGROUND
  Medical documentation is applied in various settings including patient care and clinical research. Since procedures of medical documentation are heterogeneous and developed further, secondary use of medical data is complicated. Development of medical forms, merging of data from different sources and meta-analyses of different data sets are currently a predominantly manual process and therefore difficult and cumbersome. Available applications to automate these processes are limited. In particular, tools to compare multiple documentation forms are missing. The objective of this work is to design, implement and evaluate the new system ODMSummary for comparison of multiple forms with a high number of semantically annotated data elements and a high level of usability.
  
  
  METHODS
  System requirements are the capability to summarize and compare a set of forms, enable to estimate the documentation effort, track changes in different versions of forms and find comparable items in different forms. Forms are provided in Operational Data Model format with semantic annotations from the Unified Medical Language System. 12 medical experts were invited to participate in a 3-phase evaluation of the tool regarding usability.
  
  
  RESULTS
  ODMSummary (available at https://odmtoolbox.uni-muenster.de/summary/summary.html) provides a structured overview of multiple forms and their documentation fields. This comparison enables medical experts to assess multiple forms or whole datasets for secondary use. System usability was optimized based on expert feedback.
  
  
  CONCLUSIONS
  The evaluation demonstrates that feedback from domain experts is needed to identify usability issues. In conclusion, this work shows that automatic comparison of multiple forms is feasible and the results are usable for medical experts.
authors.affiliation: Institute of Medical Informatics, University of Münster, Münster, Germany.
authors.forename: Michael
authors.identifier: http://orcid.org/0000-0002-8160-0184
authors.initials: M
authors.lastname: Storck
authors.affiliation: Institute of Medical Informatics, University of Münster, Münster, Germany.
authors.forename: Rainer
authors.initials: R
authors.lastname: Krumm
authors.affiliation: Institute of Medical Informatics, University of Münster, Münster, Germany.
authors.forename: Martin
authors.initials: M
authors.lastname: Dugas
mesh_terms: D059019:Clinical Coding / Q000379:methods*; D006801:Humans; D008499:Medical Records / Q000592:standards; D016347:Medical Records Systems, Computerized / Q000295:instrumentation*; D012660:Semantics; D017432:Unified Medical Language System; D064878:Web Browser