title: Enabling multi-level relevance feedback on PubMed by integrating rank learning into DBMS.
abstract: BACKGROUND
  Finding relevant articles from PubMed is challenging because it is hard to express the user's specific intention in the given query interface, and a keyword query typically retrieves a large number of results. Researchers have applied machine learning techniques to find relevant articles by ranking the articles according to the learned relevance function. However, the process of learning and ranking is usually done offline without integrated with the keyword queries, and the users have to provide a large amount of training documents to get a reasonable learning accuracy. This paper proposes a novel multi-level relevance feedback system for PubMed, called RefMed, which supports both ad-hoc keyword queries and a multi-level relevance feedback in real time on PubMed.
  
  
  RESULTS
  RefMed supports a multi-level relevance feedback by using the RankSVM as the learning method, and thus it achieves higher accuracy with less feedback. RefMed "tightly" integrates the RankSVM into RDBMS to support both keyword queries and the multi-level relevance feedback in real time; the tight coupling of the RankSVM and DBMS substantially improves the processing time. An efficient parameter selection method for the RankSVM is also proposed, which tunes the RankSVM parameter without performing validation. Thereby, RefMed achieves a high learning accuracy in real time without performing a validation process. RefMed is accessible at http://dm.postech.ac.kr/refmed.
  
  
  CONCLUSIONS
  RefMed is the first multi-level relevance feedback system for PubMed, which achieves a high accuracy with less feedback. It effectively learns an accurate relevance function from the user's feedback and efficiently processes the function to return relevant articles in real time.
authors.affiliation: CSE Department, POSTECH, Pohang, South Korea.
authors.forename: Hwanjo
authors.initials: H
authors.lastname: Yu
authors.forename: Taehoon
authors.initials: T
authors.lastname: Kim
authors.forename: Jinoh
authors.initials: J
authors.lastname: Oh
authors.forename: Ilhwan
authors.initials: I
authors.lastname: Ko
authors.forename: Sungchul
authors.initials: S
authors.lastname: Kim
authors.forename: Wook-Shin
authors.initials: WS
authors.lastname: Han
mesh_terms: D000465:Algorithms; D001185:Artificial Intelligence; D019295:Computational Biology / Q000379:methods*; D003627:Data Interpretation, Statistical; D003628:Database Management Systems; D005246:Feedback; D039781:PubMed; D015203:Reproducibility of Results; D014584:User-Computer Interface
references.citation: BMC Bioinformatics. 2008 Feb 19;9:108
references.pmid: 18284683
references.citation: BMC Bioinformatics. 2005 Mar 24;6:75
references.pmid: 15790421
references.citation: Bioinformatics. 2009 Apr 1;25(7):974-6
references.pmid: 18326507
references.citation: BMC Complement Altern Med. 2003 Jul 7;3:3
references.pmid: 12846931
references.citation: BMC Med Inform Decis Mak. 2007 Jan 10;7:1
references.pmid: 17214888
references.citation: J Am Med Inform Assoc. 2009 Jan-Feb;16(1):32-6
references.pmid: 18952932
references.citation: J Am Med Inform Assoc. 2007 Nov-Dec;14(6):772-80
references.pmid: 17712086
references.citation: J Am Med Inform Assoc. 2007 Sep-Oct;14(5):651-61
references.pmid: 17600104
references.citation: Neural Netw. 2004 Jan;17(1):113-26
references.pmid: 14690712