title: Multi-topic assignment for exploratory navigation of consumer health information in NetWellness using formal concept analysis.
abstract: BACKGROUND
  Finding quality consumer health information online can effectively bring important public health benefits to the general population. It can empower people with timely and current knowledge for managing their health and promoting wellbeing. Despite a popular belief that search engines such as Google can solve all information access problems, recent studies show that using search engines and simple search terms is not sufficient. Our objective is to provide an approach to organizing consumer health information for navigational exploration, complementing keyword-based direct search. Multi-topic assignment to health information, such as online questions, is a fundamental step for navigational exploration.
  
  
  METHODS
  We introduce a new multi-topic assignment method combining semantic annotation using UMLS concepts (CUIs) and Formal Concept Analysis (FCA). Each question was tagged with CUIs identified by MetaMap. The CUIs were filtered with term-frequency and a new term-strength index to construct a CUI-question context. The CUI-question context and a topic-subject context were used for multi-topic assignment, resulting in a topic-question context. The topic-question context was then directly used for constructing a prototype navigational exploration interface.
  
  
  RESULTS
  Experimental evaluation was performed on the task of automatic multi-topic assignment of 99 predefined topics for about 60,000 consumer health questions from NetWellness. Using example-based metrics, suitable for multi-topic assignment problems, our method achieved a precision of 0.849, recall of 0.774, and F₁ measure of 0.782, using a reference standard of 278 questions with manually assigned topics. Compared to NetWellness' original topic assignment, a 36.5% increase in recall is achieved with virtually no sacrifice in precision.
  
  
  CONCLUSIONS
  Enhancing the recall of multi-topic assignment without sacrificing precision is a prerequisite for achieving the benefits of navigational exploration. Our new multi-topic assignment method, combining term-strength, FCA, and information retrieval techniques, significantly improved recall and performed well according to example-based metrics.
authors.forename: Licong
authors.initials: L
authors.lastname: Cui
authors.forename: Rong
authors.initials: R
authors.lastname: Xu
authors.forename: Zhihui
authors.initials: Z
authors.lastname: Luo
authors.forename: Susan
authors.initials: S
authors.lastname: Wentz
authors.forename: Kyle
authors.initials: K
authors.lastname: Scarberry
authors.affiliation: Department of Electrical Engineering and Computer Science, Case Western Reserve University, Cleveland OH 44106, USA. gq@case.edu.
authors.forename: Guo-Qiang
authors.initials: GQ
authors.lastname: Zhang
mesh_terms: D054626:Consumer Health Information; D006801:Humans; D016247:Information Storage and Retrieval; D008491:Medical Informatics Applications; D014584:User-Computer Interface
references.citation: J Biomed Inform. 2010 Dec;43(6):962-71
references.pmid: 20670693
references.citation: AMIA Annu Symp Proc. 2014 Nov 14;2014:432-41
references.pmid: 25954347
references.citation: Nucleic Acids Res. 2004 Jan 1;32(Database issue):D267-70
references.pmid: 14681409
references.citation: JAMA. 2001 May 23-30;285(20):2612-21
references.pmid: 11368735
references.citation: J Am Med Inform Assoc. 2006 Jan-Feb;13(1):24-9
references.pmid: 16221948
references.citation: J Am Med Inform Assoc. 2005 May-Jun;12(3):296-8
references.pmid: 15684123
references.citation: J Biomed Inform. 2011 Aug;44(4):576-86
references.pmid: 21277997
references.citation: J Am Med Inform Assoc. 2010 May-Jun;17(3):229-36
references.pmid: 20442139
references.citation: J Med Internet Res. 2014 Feb 10;16(2):e45
references.pmid: 24513593