title: A Data Preparation Methodology in Data Mining Applied to Mortality Population Databases.
abstract: It is known that the data preparation phase is the most time consuming in the data mining process, using up to 50% or up to 70% of the total project time. Currently, data mining methodologies are of general purpose and one of their limitations is that they do not provide a guide about what particular task to develop in a specific domain. This paper shows a new data preparation methodology oriented to the epidemiological domain in which we have identified two sets of tasks: General Data Preparation and Specific Data Preparation. For both sets, the Cross-Industry Standard Process for Data Mining (CRISP-DM) is adopted as a guideline. The main contribution of our methodology is fourteen specialized tasks concerning such domain. To validate the proposed methodology, we developed a data mining system and the entire process was applied to real mortality databases. The results were encouraging because it was observed that the use of the methodology reduced some of the time consuming tasks and the data mining system showed findings of unknown and potentially useful patterns for the public health services in Mexico.
authors.affiliation: Tecnológico Nacional de México / CENIDET, Interior Internado Palmira s/n, Palmira, 62490, Cuernavaca, Morelos, Mexico.
authors.forename: Joaquín
authors.initials: J
authors.lastname: Pérez
authors.affiliation: Tecnológico Nacional de México / CENIDET, Interior Internado Palmira s/n, Palmira, 62490, Cuernavaca, Morelos, Mexico. jpo_cenidet@yahoo.com.mx.
authors.forename: Emmanuel
authors.initials: E
authors.lastname: Iturbide
authors.affiliation: Tecnológico Nacional de México / CENIDET, Interior Internado Palmira s/n, Palmira, 62490, Cuernavaca, Morelos, Mexico.
authors.forename: Víctor
authors.initials: V
authors.lastname: Olivares
authors.affiliation: Tecnológico Nacional de México / CENIDET, Interior Internado Palmira s/n, Palmira, 62490, Cuernavaca, Morelos, Mexico.|Universidad Politécnica de Madrid, ETSII, Boadilla del Monte, Madrid, Spain.
authors.forename: Miguel
authors.initials: M
authors.lastname: Hidalgo
authors.affiliation: Tecnológico Nacional de México / CENIDET, Interior Internado Palmira s/n, Palmira, 62490, Cuernavaca, Morelos, Mexico.
authors.forename: Alicia
authors.initials: A
authors.lastname: Martínez
authors.affiliation: Tecnológico Nacional de México / CENIDET, Interior Internado Palmira s/n, Palmira, 62490, Cuernavaca, Morelos, Mexico.
authors.forename: Nelva
authors.initials: N
authors.lastname: Almanza
mesh_terms: D000465:Algorithms; D002423:Cause of Death; D019352:Censuses; D057225:Data Mining / Q000379:methods*; D016208:Databases, Factual; D004812:Epidemiologic Methods; D006801:Humans; D008800:Mexico / Q000453:epidemiology; D009369:Neoplasms / Q000401:mortality*; D012111:Residence Characteristics
keywords: Censuses databases; Data preparation methodology; Epidemiological data mining; Mortality databases