title: Knowledge-based methods to help clinicians find answers in MEDLINE.
abstract: OBJECTIVE
  Large databases of published medical research can support clinical decision making by providing physicians with the best available evidence. The time required to obtain optimal results from these databases using traditional systems often makes accessing the databases impractical for clinicians. This article explores whether a hybrid approach of augmenting traditional information retrieval with knowledge-based methods facilitates finding practical clinical advice in the research literature.
  
  
  METHODS
  Three experimental systems were evaluated for their ability to find MEDLINE citations providing answers to clinical questions of different complexity. The systems (SemRep, Essie, and CQA-1.0), which rely on domain knowledge and semantic processing to varying extents, were evaluated separately and in combination. Fifteen therapy and prevention questions in three categories (general, intermediate, and specific questions) were searched. The first 10 citations retrieved by each system were randomized, anonymized, and evaluated on a three-point scale. The reasons for ratings were documented.
  
  
  METHODS
  Metrics evaluating the overall performance of a system (mean average precision, binary preference) and metrics evaluating the number of relevant documents in the first several presented to a physician were used.
  
  
  RESULTS
  Scores (mean average precision = 0.57, binary preference = 0.71) for fusion of the retrieval results of the three systems are significantly (p < 0.01) better than those for any individual system. All three systems present three to four relevant citations in the first five for any question type.
  
  
  CONCLUSIONS
  The improvements in finding relevant MEDLINE citations due to knowledge-based processing show promise in assisting physicians to answer questions in clinical practice.
authors: National Library of Medicine, 8600 Rockville Pike, Bethesda, MD 20894, USA. charlie@nlm.nih.gov
authors: Charles A
authors: CA
authors: Sneiderman
authors: Dina
authors: D
authors: Demner-Fushman
authors: Marcelo
authors: M
authors: Fiszman
authors: Nicholas C
authors: NC
authors: Ide
authors: Thomas C
authors: TC
authors: Rindflesch
mesh_terms: D000043:Abstracting and Indexing; D016247:Information Storage and Retrieval / Q000379:methods*; D051188:Knowledge Bases; D016239:MEDLINE; D046650:Medical Subject Headings
references: AMIA Annu Symp Proc. 2006;:180-4
references: 17238327
references: AMIA Annu Symp Proc. 2006;:151-5
references: 17238321
references: AMIA Annu Symp Proc. 2006;:945
references: 17238564
references: J Am Med Inform Assoc. 2007 May-Jun;14(3):253-63
references: 17329729
references: BMJ. 2000 Aug 12;321(7258):429-32
references: 10938054
references: Proc AMIA Symp. 2000;:344-8
references: 11079902
references: Med J Malaysia. 2000 Dec;55(4):486-92
references: 11221162
references: Stud Health Technol Inform. 2001;84(Pt 1):181-5
references: 11604729
references: Stud Health Technol Inform. 2001;84(Pt 1):216-20
references: 11604736
references: Stud Health Technol Inform. 2001;84(Pt 1):390-3
references: 11604770
references: Proc AMIA Symp. 2001;:17-21
references: 11825149
references: BMJ. 2002 Mar 23;324(7339):710
references: 11909789
references: Pediatrics. 2004 Jan;113(1 Pt 1):64-9
references: 14702450
references: AMIA Annu Symp Proc. 2003;:239-43
references: 14728170
references: J Biomed Inform. 2003 Dec;36(6):462-77
references: 14759819
references: Stud Health Technol Inform. 2004;107(Pt 2):773-7
references: 15360917
references: Bioinformatics. 2004 Sep 22;20(14):2320-1
references: 15073016
references: Proc Annu Symp Comput Appl Med Care. 1991;:808-12
references: 1807718
references: Bull Med Libr Assoc. 2000 Jul;88(3):239-46
references: 10928709
references: JAMA. 1993 Nov 3;270(17):2096-7
references: 8411578
references: Methods Inf Med. 1993 Aug;32(4):281-91
references: 8412823
references: JAMA. 1993 Dec 1;270(21):2598-601
references: 8230645
references: Proc Annu Symp Comput Appl Med Care. 1994;:235-9
references: 7949926
references: ACP J Club. 1995 Nov-Dec;123(3):A12-3
references: 7582737
references: J Am Med Inform Assoc. 1996 Mar-Apr;3(2):157-67
references: 8653452
references: Bull Med Libr Assoc. 1996 Jul;84(3):351-8
references: 8883983
references: Proc AMIA Annu Fall Symp. 1997;:485-9
references: 9357673
references: Proc AMIA Annu Fall Symp. 1997;:528-32
references: 9357682
references: J Am Med Inform Assoc. 1998 Jan-Feb;5(1):62-75
references: 9452986
references: Proc AMIA Symp. 1998;:320-4
references: 9929234
references: ACP J Club. 2005 Jan-Feb;142(1):A8-9
references: 15656539
references: J Med Libr Assoc. 2005 Jan;93(1):88-96
references: 15685280
references: Artif Intell Med. 2005 Feb;33(2):179-98
references: 15811784
references: J Am Med Inform Assoc. 2005 Jul-Aug;12(4):458-73
references: 15802487
references: Ann Fam Med. 2005 Nov-Dec;3(6):507-13
references: 16338914
references: AMIA Annu Symp Proc. 2005;:191-5
references: 16779028
references: AMIA Annu Symp Proc. 2005;:1117
references: 16779404
references: J Am Med Inform Assoc. 2006 Nov-Dec;13(6):653-9
references: 16929042
references: AMIA Annu Symp Proc. 2006;:190-4
references: 17238329