PWIDB: A framework for learning to classify imbalanced data streams with incremental data re-balancing technique
Autor: | Rafiq Ahmed Mohammed, Xuequn Wang, Mohd Fairuz Shiratuddin, Kevin Wong |
---|---|
Rok vydání: | 2020 |
Předmět: |
Data stream mining
Computer science Active learning (machine learning) 020206 networking & telecommunications 02 engineering and technology STREAMS computer.software_genre Imbalanced data Statistical classification 0202 electrical engineering electronic engineering information engineering General Earth and Planetary Sciences 020201 artificial intelligence & image processing Data mining computer General Environmental Science |
Zdroj: | KES |
ISSN: | 1877-0509 |
Popis: | The performance of classification algorithms with highly imbalanced streaming data depends upon efficient balancing strategy. Some techniques of balancing strategy have been applied using static batch data to resolve the class imbalance problem, which is difficult if applied for massive data streams. In this paper, a new Piece-Wise Incremental Data re-Balancing (PWIDB) framework is proposed. The PWIDB framework combines automated balancing techniques using Racing Algorithm (RA) and incremental rebalancing technique. RA is an active learning approach capable of classifying imbalanced data and can provide a way to select an appropriate re-balancing technique with imbalanced data. In this paper, we have extended the capability of RA for handling imbalanced data streams in the proposed PWIDB framework. The PWIDB accumulates previous knowledge with increments of re-balanced data and captures the concept of the imbalanced instances. The PWIDB is an incremental streaming batch framework, which is suitable for learning with streaming imbalanced data. We compared the performance of PWIDB with a well-known FLORA technique. Experimental results show that the PWIDB framework exhibits an improved and stable performance compared to FLORA and accumulative re-balancing techniques. |
Databáze: | OpenAIRE |
Externí odkaz: |