Clustering mixed numerical and categorical data with missing values
Autor: | Van-Nam Huynh, Duy-Tai Dinh, Songsak Sriboonchitta |
---|---|
Rok vydání: | 2021 |
Předmět: |
Information Systems and Management
Computer science Initialization 02 engineering and technology Measure (mathematics) Theoretical Computer Science Set (abstract data type) Artificial Intelligence 0202 electrical engineering electronic engineering information engineering Imputation (statistics) Cluster analysis Categorical variable business.industry 05 social sciences 050301 education Pattern recognition Missing data Computer Science Applications ComputingMethodologies_PATTERNRECOGNITION Control and Systems Engineering Scalability 020201 artificial intelligence & image processing Artificial intelligence business 0503 education Software |
Zdroj: | Information Sciences. 571:418-442 |
ISSN: | 0020-0255 |
DOI: | 10.1016/j.ins.2021.04.076 |
Popis: | This paper proposes a novel framework for clustering mixed numerical and categorical data with missing values. It integrates the imputation and clustering steps into a single process, which results in an algorithm named C lustering M ixed Numerical and Categorical Data with M issing Values (k-CMM). The algorithm consists of three phases. The initialization phase splits the input dataset into two parts based on missing values in objects and attributes types. The imputation phase uses the decision-tree-based method to find the set of correlated data objects. The clustering phase uses the mean and kernel-based methods to form cluster centers at numerical and categorical attributes, respectively. The algorithm also uses the squared Euclidean and information-theoretic-based dissimilarity measure to compute the distances between objects and cluster centers. An extensive experimental evaluation was conducted on real-life datasets to compare the clustering quality of k-CMM with state-of-the-art clustering algorithms. The execution time, memory usage, and scalability of k-CMM for various numbers of clusters or data sizes were also evaluated. Experimental results show that k-CMM can efficiently cluster missing mixed datasets as well as outperform other algorithms when the number of missing values increases in the datasets. |
Databáze: | OpenAIRE |
Externí odkaz: |