Performance comparison of multi-label learning algorithms on clinical data for chronic diseases.
We are motivated by the issue of classifying diseases of chronically ill patients to assist physicians in their everyday work. Our goal is to provide a performance comparison of state-of-the-art multi-label learning algorithms for the analysis of multivariate sequential clinical data from medical records of patients affected by chronic diseases. As a matter of fact, the multi-label learning approach appears to be a good candidate for modeling overlapped medical conditions, specific to chronically ill patients. With the availability of such comparison study, the evaluation of new algorithms should be enhanced. According to the method, we choose a summary statistics approach for the processing of the sequential clinical data, so that the extracted features maintain an interpretable link to their corresponding medical records. The publicly available MIMIC-II dataset, which contains more than 19,000 patients with chronic diseases, is used in this study. For the comparison we selected the following multi-label algorithms: ML-kNN, AdaBoostMH, binary relevance, classifier chains, HOMER and RAkEL. Regarding the results, binary relevance approaches, despite their elementary design and their independence assumption concerning the chronic illnesses, perform optimally in most scenarios, in particular for the detection of relevant diseases. In addition, binary relevance approaches scale up to large dataset and are easy to learn. However, the RAkEL algorithm, despite its scalability problems when it is confronted to large dataset, performs well in the scenario which consists of the ranking of the labels according to the dominant disease of the patient.
AISLab, Institute of Information Systems, University of Applied Sciences and Arts Western Switzerland, Techno-Pôle 3, 3960 Sierre, Switzerland; DIVA research group, Department of Informatics, University of Fribourg, Bd de Pérolles 90, 1700 Fribourg, Switzerland. Electronic address: damien.zufferey@unifr.ch.
Damien
D
Zufferey
AISLab, Institute of Information Systems, University of Applied Sciences and Arts Western Switzerland, Techno-Pôle 3, 3960 Sierre, Switzerland. Electronic address: thomas.hofer@hevs.ch.
Thomas
T
Hofer
DIVA research group, Department of Informatics, University of Fribourg, Bd de Pérolles 90, 1700 Fribourg, Switzerland. Electronic address: jean.hennebert@unifr.ch.
Jean
J
Hennebert
AISLab, Institute of Information Systems, University of Applied Sciences and Arts Western Switzerland, Techno-Pôle 3, 3960 Sierre, Switzerland. Electronic address: michael.schumacher@hevs.ch.
Michael
M
Schumacher
DIVA research group, Department of Informatics, University of Fribourg, Bd de Pérolles 90, 1700 Fribourg, Switzerland. Electronic address: rolf.ingold@unifr.ch.
Rolf
R
Ingold
AISLab, Institute of Information Systems, University of Applied Sciences and Arts Western Switzerland, Techno-Pôle 3, 3960 Sierre, Switzerland. Electronic address: stefano.bromuri@hevs.ch.
Stefano
S
Bromuri
D000465:Algorithms; D002908:Chronic Disease; D016208:Databases, Factual; D003936:Diagnosis, Computer-Assisted / Q000379:methods*; D005260:Female; D006801:Humans; D000069550:Machine Learning; D008297:Male
Chronic disease; Clinical data; Complex patient; Multi-label learning; Summary statistics