Reformulation of consumer health queries with professional terminology: a pilot study.
BACKGROUND
The Internet is becoming an increasingly important resource for health-information seekers. However, consumers often do not use effective search strategies. Query reformulation is one potential intervention to improve the effectiveness of consumer searches.


OBJECTIVE
We endeavored to answer the research question: "Does reformulating original consumer queries with preferred terminology from the Unified Medical Language System (UMLS) Metathesaurus lead to better search returns?"


METHODS
Consumer-generated queries with known goals (n=16) that could be mapped to UMLS Metathesaurus terminology were used as test samples. Reformulated queries were generated by replacing user terms with Metathesaurus-preferred synonyms (n=18). Searches (n=36) were performed using both a consumer information site and a general search engine. Top 30 precision was used as a performance indicator to compare the performance of the original and reformulated queries.


RESULTS
Forty-two percent of the searches utilizing reformulated queries yielded better search returns than their associated original queries, 19% yielded worse results, and the results for the remaining 39% did not change. We identified ambiguous lay terms, expansion of acronyms, and arcane professional terms as causes for changes in performance.


CONCLUSIONS
We noted a trend towards increased precision when providing substitutions for lay terms, abbreviations, and acronyms. We have found qualitative evidence that reformulating queries with professional terminology may be a promising strategy to improve consumer health-information searches, although we caution that automated reformulation could in fact worsen search performance when the terminology is ill-fitted or arcane.
Decision Systems Group, Thorn 310, Brigham and Women's Hospital, 75 Francis Street, Boston, MA 02115, USA. plovnick@dsg.harvard.edu
Robert M
RM
Plovnick
Qing T
QT
Zeng
D003258:Consumer Behavior; D006801:Humans; D007255:Information Services / Q000592:standards*; D020407:Internet / Q000592:standards*; D049293:MedlinePlus / Q000592:standards; D010353:Patient Education as Topic; D010865:Pilot Projects; D017432:Unified Medical Language System / Q000592:standards*; D014584:User-Computer Interface