title: Evaluating learning models with transitions of human interests based on objective rule evaluation indices.
abstract: This paper presents a method to support the evaluation procedure of a data mining process using human-system interaction. The post-processing of mined results is one of the key factors for successful data mining process. However, it is difficult for human experts to completely evaluate several thousands of rules from a large dataset containing noise. We have designed a method based on objective rule evaluation indices to support the rule evaluation procedure; the indices are calculated to evaluate each if-then rule mathematically. We have evaluated five representative learning algorithms to construct rule evaluation models of the actual data mining results from a chronic hepatitis data set. Further, we discuss the relationship between the transitions of the subjective criterion of a medical expert and the performances of the rule evaluation models.
authors.affiliation: Department of Medical Informatics, Shimane University, School of Medicine, Japan. abe@med.shimane-u.ac.jp
authors.forename: Hidenao
authors.initials: H
authors.lastname: Abe
authors.forename: Hideto
authors.initials: H
authors.lastname: Yokoi
authors.forename: Shusaku
authors.initials: S
authors.lastname: Tsumoto
authors.forename: Miho
authors.initials: M
authors.lastname: Ohsaki
authors.forename: Takahira
authors.initials: T
authors.lastname: Yamaguchi
mesh_terms: D000465:Algorithms; D001185:Artificial Intelligence; D005069:Evaluation Studies as Topic; D006525:Hepatitis, Viral, Human; D006801:Humans; D019451:Information Management; D016247:Information Storage and Retrieval