Mapping high-dimensional data onto a relative distance plane—an exact method for visualizing and characterizing high-dimensional patterns
| Autor: | Brion Dolenko, M. Mandelzweig, Alexander E. Nikulin, Aleksander B. Demko, R. L. Somorjai, Richard Baumgartner, Nicolino J. Pizzi |
|---|---|
| Rok vydání: | 2004 |
| Předmět: |
Clustering high-dimensional data
Similarity (geometry) Databases Factual Computer science Information Storage and Retrieval Health Informatics computer.software_genre Pattern Recognition Automated User-Computer Interface Data visualization Artificial Intelligence Computer Graphics Representation (mathematics) Statistical hypothesis testing business.industry Pattern recognition Visualization Computer Science Applications Exploratory data analysis Distance matrix Database Management Systems Artificial intelligence Data mining business computer Algorithms |
| Zdroj: | Journal of Biomedical Informatics. 37(5):366-379 |
| ISSN: | 1532-0464 |
| DOI: | 10.1016/j.jbi.2004.07.005 |
| Popis: | We introduce a distance (similarity)—based mapping for the visualization of high-dimensional patterns and their relative relationships. The mapping preserves exactly the original distances between points with respect to any two reference patterns in a special two-dimensional coordinate system, the relative distance plane (RDP). As only a single calculation of a distance matrix is required, this method is computationally efficient, an essential requirement for any exploratory data analysis. The data visualization afforded by this representation permits a rapid assessment of class pattern distributions. In particular, we can determine with a simple statistical test whether both training and validation sets of a 2-class, high-dimensional dataset derive from the same class distributions. We can explore any dataset in detail by identifying the subset of reference pairs whose members belong to different classes, cycling through this subset, and for each pair, mapping the remaining patterns. These multiple viewpoints facilitate the identification and confirmation of outliers. We demonstrate the effectiveness of this method on several complex biomedical datasets. Because of its efficiency, effectiveness, and versatility, one may use the RDP representation as an initial, data mining exploration that precedes classification by some classifier. Once final enhancements to the RDP mapping software are completed, we plan to make it freely available to researchers. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
Full Text from ScienceDirect