Evaluation of a document search engine in a clinical department system.
MorphoSaurus, a concept-based document search engine,was incorporated into an EHR system in order to support search across the whole corpus of patient discharge letters and other clinically relevant documents. A user survey showed a general satisfaction with the system and revealed novel usages for information stored in discharge letters.The retrieval system was also used to identify relevant documents for a five-year retrospective survey of suspicious syphilis cases in the department. This retrieval scenario was used to assess the performance of MorphoSaurus against a manually created gold standard. A substring search for the German words "syphilis" and"lues" was used as baseline. The system yielded a precision p = 20.1% and a recall r = 100%. The values for the substring "syphilis" were p = 65.5% and r = 47.5%, for"lues" p = 15.4% and r = 87.7%. The results support the use of the proposed recall-oriented search across EHR documents to acquire valid and complete data for epidemiology studies in hospital populations.
Schulz
Stefan
S
Institute of Medical Biometry und Medical Informatics, University Medical Center Freiburg, Germany.
Daumke
Philipp
P
Fischer
Pascal
P
Müller
Marcel
M
Müller
Marcel Lucas
ML
D000465:Algorithms; D001185:Artificial Intelligence; D001291:Attitude of Health Personnel; D003258:Consumer Behavior; D003628:Database Management Systems / Q000706:statistics & numerical data*; D004282:Documentation / Q000379:methods*; D005858:Germany; D016247:Information Storage and Retrieval / Q000379:methods*; D016347:Medical Records Systems, Computerized / Q000706:statistics & numerical data*; D009323:Natural Language Processing; D010363:Pattern Recognition, Automated / Q000379:methods*; D011795:Surveys and Questionnaires; D014584:User-Computer Interface