title: Analysis of a multilevel diagnosis decision support system and its implications: a case study.
abstract: Medical diagnosis can be performed in an automatic way with the use of computer-based systems or algorithms. Such systems are usually called diagnostic decision support systems (DDSSs) or medical diagnosis systems (MDSs). An evaluation of the performance of a DDSS called ML-DDSS has been performed in this paper. The methodology is based on clinical case resolution performed by physicians which is then used to evaluate the behavior of ML-DDSS. This methodology allows the calculation of values for several well-known metrics such as precision, recall, accuracy, specificity, and Matthews correlation coefficient (MCC). Analysis of the behavior of ML-DDSS reveals interesting results about the behavior of the system and of the physicians who took part in the evaluation process. Global results show how the ML-DDSS system would have significant utility if used in medical practice. The MCC metric reveals an improvement of about 30% in comparison with the experts, and with respect to sensitivity the system returns better results than the experts.
authors: Centre for Plant Biotechnology and Genomics UPM-INIA, Polytechnic University of Madrid, Parque Científico y Tecnológico de la U.P.M. Campus de Montegancedo, Pozuelo de Alarcón, 28223 Madrid, Spain. alejandro.rodriguezg@upm.es
authors: Alejandro
authors: A
authors: Rodríguez-González
authors: Javier
authors: J
authors: Torres-Niño
authors: Miguel A
authors: MA
authors: Mayer
authors: Giner
authors: G
authors: Alor-Hernandez
authors: Mark D
authors: MD
authors: Wilkinson
mesh_terms: D000465:Algorithms; D020000:Decision Support Systems, Clinical; D003661:Decision Support Techniques; D005103:Expert Systems; D005759:Gastroenteritis / Q000175:diagnosis; D006801:Humans; D007251:Influenza, Human / Q000175:diagnosis; D051188:Knowledge Bases; D008297:Male; D008490:Medical Informatics; D008875:Middle Aged; D015233:Models, Statistical; D010820:Physicians; D011014:Pneumonia / Q000175:diagnosis; D011704:Pyelonephritis / Q000175:diagnosis; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity