Enabling multi-level relevance feedback on PubMed by integrating rank learning into DBMS.
BACKGROUND
Finding relevant articles from PubMed is challenging because it is hard to express the user's specific intention in the given query interface, and a keyword query typically retrieves a large number of results. Researchers have applied machine learning techniques to find relevant articles by ranking the articles according to the learned relevance function. However, the process of learning and ranking is usually done offline without integrated with the keyword queries, and the users have to provide a large amount of training documents to get a reasonable learning accuracy. This paper proposes a novel multi-level relevance feedback system for PubMed, called RefMed, which supports both ad-hoc keyword queries and a multi-level relevance feedback in real time on PubMed.


RESULTS
RefMed supports a multi-level relevance feedback by using the RankSVM as the learning method, and thus it achieves higher accuracy with less feedback. RefMed "tightly" integrates the RankSVM into RDBMS to support both keyword queries and the multi-level relevance feedback in real time; the tight coupling of the RankSVM and DBMS substantially improves the processing time. An efficient parameter selection method for the RankSVM is also proposed, which tunes the RankSVM parameter without performing validation. Thereby, RefMed achieves a high learning accuracy in real time without performing a validation process. RefMed is accessible at http://dm.postech.ac.kr/refmed.


CONCLUSIONS
RefMed is the first multi-level relevance feedback system for PubMed, which achieves a high accuracy with less feedback. It effectively learns an accurate relevance function from the user's feedback and efficiently processes the function to return relevant articles in real time.
Yu
Hwanjo
H
CSE Department, POSTECH, Pohang, South Korea.
Kim
Taehoon
T
Oh
Jinoh
J
Ko
Ilhwan
I
Kim
Sungchul
S
Han
Wook-Shin
WS
D000465:Algorithms; D001185:Artificial Intelligence; D019295:Computational Biology / Q000379:methods*; D003627:Data Interpretation, Statistical; D003628:Database Management Systems; D005246:Feedback; D039781:PubMed; D015203:Reproducibility of Results; D014584:User-Computer Interface
BMC Bioinformatics. 2008 Feb 19;9:108
18284683
BMC Bioinformatics. 2005 Mar 24;6:75
15790421
Bioinformatics. 2009 Apr 1;25(7):974-6
18326507
BMC Complement Altern Med. 2003 Jul 7;3:3
12846931
BMC Med Inform Decis Mak. 2007 Jan 10;7:1
17214888
J Am Med Inform Assoc. 2009 Jan-Feb;16(1):32-6
18952932
J Am Med Inform Assoc. 2007 Nov-Dec;14(6):772-80
17712086
J Am Med Inform Assoc. 2007 Sep-Oct;14(5):651-61
17600104
Neural Netw. 2004 Jan;17(1):113-26
14690712