When Should We Ignore Examples with Missing Values?
| Autor: | Wei Chao Lin, Shih Wen Ke, Chih-Fong Tsai |
|---|---|
| Rok vydání: | 2017 |
| Předmět: |
Computer science
business.industry 02 engineering and technology Machine learning computer.software_genre Missing data Hardware and Architecture 020204 information systems 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing Case deletion Artificial intelligence Imputation (statistics) business Categorical variable computer Software |
| Zdroj: | International Journal of Data Warehousing and Mining. 13:53-63 |
| ISSN: | 1548-3932 1548-3924 |
| DOI: | 10.4018/ijdwm.2017100104 |
| Popis: | In practice, the dataset collected from data mining usually contains some missing values. It is common practice to perform case deletion by ignoring those data with missing values if the missing rate is certainly small. The aim of this paper is to answer the following question: When should one directly ignore sampled data with missing values? By using different types of datasets having various numbers of attributes, data samples, and classes, it is found that there are some specific patterns that can be considered for case deletion over different datasets without significant performance degradation. In particular, these patterns are extracted to act as the decision rules by a decision tree model. In addition, a comparison is made between cases with deletion and imputation over different datasets with the allowed missing rates and the decision rules. The results show that the classification performance results obtained by case deletion and imputation are similar, which demonstrates the reliability of the extracted decision rules. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|