Computer algorithm for automated work group classification from free text: the DREAM technique.
OBJECTIVE
This study developed and tested a computer method to automatically assign subjects to aggregate work groups based on their free text work descriptions.


METHODS
The Double Root Extended Automated Matcher (DREAM) algorithm classifies individuals based on pairs of subjects' free text word roots in common with those of standard classification systems and several explicitly defined linkages between term roots and aggregates.


RESULTS
DREAM effectively analyzed free text from 5887 participants in a multisite chronic obstructive pulmonary disease prevention study (Lung Health Study). For a test set of 533 cases, DREAMs classifications compared favorably with those of a four-human panel. The humans rated the accuracy of DREAM as good or better in 80% of the test cases.


CONCLUSIONS
Automated text interpretation is a promising tool for analyzing large data sets for applications in data mining, research, and surveillance. Work descriptive information is most useful when it can link an individual to aggregate entities that have occupational health relevance. Determining the appropriate group requires considerable expertise. This article describes a new method for making such assignments using a computer algorithm to reduce dependence on the limited number of occupational health experts. In addition, computer algorithms foster consistency of assignments.
Harber
Philip
P
Division of Occupational and Environmental Medicine, Department of Family Medicine, David Geffen School of Medicine, University of California at Los Angeles, Los Angeles, California 90024, USA. pharber@mednet.ucla.edu
Crawford
Lori
L
Cheema
Amarpreet
A
Schacter
Levanto
L
D000465:Algorithms; D004185:Disability Evaluation; D004651:Employment / Q000145:classification / Q000458:organization & administration*; D005260:Female; D006801:Humans; D008297:Male; D029424:Pulmonary Disease, Chronic Obstructive / Q000517:prevention & control; D015203:Reproducibility of Results; D012984:Software; D014937:Work / Q000145:classification*