Mapping high-dimensional data onto a relative distance plane--an exact method for visualizing and characterizing high-dimensional patterns.
We introduce a distance (similarity)-based mapping for the visualization of high-dimensional patterns and their relative relationships. The mapping preserves exactly the original distances between points with respect to any two reference patterns in a special two-dimensional coordinate system, the relative distance plane (RDP). As only a single calculation of a distance matrix is required, this method is computationally efficient, an essential requirement for any exploratory data analysis. The data visualization afforded by this representation permits a rapid assessment of class pattern distributions. In particular, we can determine with a simple statistical test whether both training and validation sets of a 2-class, high-dimensional dataset derive from the same class distributions. We can explore any dataset in detail by identifying the subset of reference pairs whose members belong to different classes, cycling through this subset, and for each pair, mapping the remaining patterns. These multiple viewpoints facilitate the identification and confirmation of outliers. We demonstrate the effectiveness of this method on several complex biomedical datasets. Because of its efficiency, effectiveness, and versatility, one may use the RDP representation as an initial, data mining exploration that precedes classification by some classifier. Once final enhancements to the RDP mapping software are completed, we plan to make it freely available to researchers.
Institute for Biodiagnostics, National Research Council Canada, 435 Ellice Avenue, Winnipeg MB, Canada R3B 1Y6. ray.somorjai@nrc-cnrc.gc.ca
R L
RL
Somorjai
B
B
Dolenko
A
A
Demko
M
M
Mandelzweig
A E
AE
Nikulin
R
R
Baumgartner
N J
NJ
Pizzi
D000465:Algorithms; D001185:Artificial Intelligence; D003196:Computer Graphics; D003628:Database Management Systems; D016208:Databases, Factual; D016247:Information Storage and Retrieval / Q000379:methods*; D010363:Pattern Recognition, Automated / Q000379:methods*; D014584:User-Computer Interface