The role of domain knowledge in automating medical text report classification.
OBJECTIVE
To analyze the effect of expert knowledge on the inductive learning process in creating classifiers for medical text reports.


METHODS
The authors converted medical text reports to a structured form through natural language processing. They then inductively created classifiers for medical text reports using varying degrees and types of expert knowledge and different inductive learning algorithms. The authors measured performance of the different classifiers as well as the costs to induce classifiers and acquire expert knowledge.


METHODS
The measurements used were classifier performance, training-set size efficiency, and classifier creation cost.


RESULTS
Expert knowledge was shown to be the most significant factor affecting inductive learning performance, outweighing differences in learning algorithms. The use of expert knowledge can affect comparisons between learning algorithms. This expert knowledge may be obtained and represented separately as knowledge about the clinical task or about the data representation used. The benefit of the expert knowledge is more than that of inductive learning itself, with less cost to obtain.


CONCLUSIONS
For medical text report classification, expert knowledge acquisition is more significant to performance and more cost-effective to obtain than knowledge discovery. Building classifiers should therefore focus more on acquiring knowledge from experts than trying to learn this knowledge inductively.
Wilcox
Adam B
AB
Department of Medical Informatics, University of Utah, Salt Lake City, USA. lpawilco@ihc.com
Hripcsak
George
G
D000465:Algorithms; D001185:Artificial Intelligence; D006801:Humans; D008499:Medical Records / Q000145:classification*; D009323:Natural Language Processing; D011014:Pneumonia / Q000000981:diagnostic imaging; D012372:ROC Curve; D013902:Radiography, Thoracic / Q000145:classification*