title: Processes and problems in the formative evaluation of an interface to the Foundational Model of Anatomy knowledge base.
abstract: The Digital Anatomist Foundational Model of Anatomy (FMA) is a large semantic network of more than 100,000 terms that refer to the anatomical entities, which together with 1.6 million structural relationships symbolically represent the physical organization of the human body. Evaluation of such a large knowledge base by domain experts is challenging because of the sheer size of the resource and the need to evaluate not just classes but also relationships. To meet this challenge, the authors have developed a relation-centric query interface, called Emily, that is able to query the entire range of classes and relationships in the FMA, yet is simple to use by a domain expert. Formative evaluation of this interface considered the ability of Emily to formulate queries based on standard anatomy examination questions, as well as the processing speed of the query engine. Results show that Emily is able to express 90% of the examination questions submitted to it and that processing time is generally 1 second or less, but can be much longer for complex queries. These results suggest that Emily will be a very useful tool, not only for evaluating the FMA, but also for querying and evaluating other large semantic networks.
authors.affiliation: Structural Informatics Group, Department of Medical Education and Biomedical Informatics, Box 352350, Computer Science and Engineering, 634 Paul Allen Center, University of Washington, Seattle, WA 98195, USA. shapiro@cs.washington.edu
authors.forename: Linda G
authors.initials: LG
authors.lastname: Shapiro
authors.forename: Emily
authors.initials: E
authors.lastname: Chung
authors.forename: Landon T
authors.initials: LT
authors.lastname: Detwiler
authors.forename: José L V
authors.initials: JL
authors.lastname: Mejino
authors.forename: Augusto V
authors.initials: AV
authors.lastname: Agoncillo
authors.forename: James F
authors.initials: JF
authors.lastname: Brinkley
authors.forename: Cornelius
authors.initials: C
authors.lastname: Rosse
mesh_terms: D000715:Anatomy / Q000145:classification*; D001185:Artificial Intelligence; D006801:Humans; D016247:Information Storage and Retrieval / Q000379:methods*; D008953:Models, Anatomic; D014584:User-Computer Interface; D018875:Vocabulary, Controlled