title: Macrostate data clustering.
abstract: We develop an effective nonhierarchical data clustering method using an analogy to the dynamic coarse graining of a stochastic system. Analyzing the eigensystem of an interitem transition matrix identifies fuzzy clusters corresponding to the metastable macroscopic states (macrostates) of a diffusive system. A "minimum uncertainty criterion" determines the linear transformation from eigenvectors to cluster-defining window functions. Eigenspectrum gap and cluster certainty conditions identify the proper number of clusters. The physically motivated fuzzy representation and associated uncertainty analysis distinguishes macrostate clustering from spectral partitioning methods. Macrostate data clustering solves a variety of test cases that challenge other methods.
authors.affiliation: Biophysics Program, Department of Molecular Biology and Genetics, Cornell University, Ithaca, NY 14853, USA.
authors.forename: Daniel
authors.initials: D
authors.lastname: Korenblum
authors.forename: David
authors.initials: D
authors.lastname: Shalloway
mesh_terms: D016000:Cluster Analysis; D015233:Models, Statistical; D008962:Models, Theoretical; D016011:Normal Distribution; D020411:Oligonucleotide Array Sequence Analysis; D013223:Statistics as Topic; D013269:Stochastic Processes