title: A general framework for learning rules from data.
abstract: With the aim of getting understandable symbolic rules to explain a given phenomenon, we split the task of learning these rules from sensory data in two phases: a multilayer perceptron maps features into propositional variables and a set of subsequent layers operated by a PAC-like algorithm learns Boolean expressions on these variables. The special features of this procedure are that: i) the neural network is trained to produce a Boolean output having the principal task of discriminating between classes of inputs; ii) the symbolic part is directed to compute rules within a family that is not known a priori; iii) the welding point between the two learning systems is represented by a feedback based on a suitability evaluation of the computed rules. The procedure we propose is based on a computational learning paradigm set up recently in some papers in the fields of theoretical computer science, artificial intelligence and cognitive systems. The present article focuses on information management aspects of the procedure. We deal with the lack of prior information about the rules through learning strategies that affect both the meaning of the variables and the description length of the rules into which they combine. The paper uses the task of learning to formally discriminate among several emotional states as both a working example and a test bench for a comparison with previous symbolic and subsymbolic methods in the field.
authors.affiliation: Dipartimento di Scienze dell'Informazione, Università di Milano, 20135 Milano, Italy. apolloni@dsi.unimi.it
authors.forename: Bruno
authors.initials: B
authors.lastname: Apolloni
authors.forename: Anna
authors.initials: A
authors.lastname: Esposito
authors.forename: Dario
authors.initials: D
authors.lastname: Malchiodi
authors.forename: Christos
authors.initials: C
authors.lastname: Orovas
authors.forename: Giorgio
authors.initials: G
authors.lastname: Palmas
authors.forename: John G
authors.initials: JG
authors.lastname: Taylor
mesh_terms: D000465:Algorithms; D001185:Artificial Intelligence; D032701:Biomimetics / Q000379:methods*; D003198:Computer Simulation; D003627:Data Interpretation, Statistical; D003661:Decision Support Techniques; D003936:Diagnosis, Computer-Assisted / Q000379:methods; D004644:Emotions / Q000145:classification; D006801:Humans; D016015:Logistic Models; D016571:Neural Networks, Computer; D010363:Pattern Recognition, Automated / Q000379:methods; D013067:Speech Perception; D013315:Stress, Psychological / Q000145:classification / Q000175:diagnosis