Click-words: learning to predict document keywords from a user perspective.
BACKGROUND
Recognizing words that are key to a document is important for ranking relevant scientific documents. Traditionally, important words in a document are either nominated subjectively by authors and indexers or selected objectively by some statistical measures. As an alternative, we propose to use documents' words popularity in user queries to identify click-words, a set of prominent words from the users' perspective. Although they often overlap, click-words differ significantly from other document keywords.


RESULTS
We developed a machine learning approach to learn the unique characteristics of click-words. Each word was represented by a set of features that included different types of information, such as semantic type, part of speech tag, term frequency-inverse document frequency (TF-IDF) weight and location in the abstract. We identified the most important features and evaluated our model using 6 months of PubMed click-through logs. Our results suggest that, in addition to carrying high TF-IDF weight, click-words tend to be biomedical entities, to exist in article titles, and to occur repeatedly in article abstracts. Given the abstract and title of a document, we are able to accurately predict the words likely to appear in user queries that lead to document clicks.
Islamaj Doğan
Rezarta
R
National Center for Biotechnology Information, National Library of Medicine, National Institutes of Health, Bethesda, MD 20894, USA.
Lu
Zhiyong
Z
D000043:Abstracting and Indexing / Q000379:methods*; D000465:Algorithms; D001185:Artificial Intelligence; D016239:MEDLINE; D039781:PubMed; D012660:Semantics
Acad Emerg Med. 1999 Apr;6(4):292-6
10230980
Bioinformatics. 2009 Aug 1;25(15):1944-51
19497938
Proc IEEE Comput Syst Bioinform Conf. 2004;:394-404
16448032
Bioinformatics. 1998;14(7):600-7
9730925
Bioinformatics. 2009 Nov 15;25(22):3031-2
19654114
Bioinformatics. 2004 Sep 22;20(14):2320-1
15073016
BMC Bioinformatics. 2008 Sep 25;9:402
18817555
Database (Oxford). 2009;2009:bap018
20157491
Proc AMIA Symp. 2001;:17-21
11825149
Stud Health Technol Inform. 2004;107(Pt 1):292-6
15360821
J Am Med Inform Assoc. 2009 Jan-Feb;16(1):32-6
18952932
Bioinformatics. 2008 Nov 1;24(21):2559-60
18772154
J Am Soc Inf Sci Technol. 2009 Feb;60(2):264-274
29456459