Learning a Nonlinear Combination of Generalized Heterogeneous Classifiers

Autor: M. Rahimi, A. A. Taheri, H. Mashayekhi
Jazyk: angličtina
Rok vydání: 2023
Předmět:
Zdroj: Journal of Artificial Intelligence and Data Mining, Vol 11, Iss 1, Pp 77-93 (2023)
Druh dokumentu: article
ISSN: 2322-5211
2322-4444
DOI: 10.22044/jadm.2022.12403.2387
Popis: Finding an effective way to combine the base learners is an essential part of constructing a heterogeneous ensemble of classifiers. In this paper, we propose a framework for heterogeneous ensembles, which investigates using an artificial neural network to learn a nonlinear combination of the base classifiers. In the proposed framework, a set of heterogeneous classifiers are stacked to produce the first-level outputs. Then these outputs are augmented using several combination functions to construct the inputs of the second-level classifier. We conduct a set of extensive experiments on 121 datasets and compare the proposed method with other established and state-of-the-art heterogeneous methods. The results demonstrate that the proposed scheme outperforms many heterogeneous ensembles, and is superior compared to singly tuned classifiers. The proposed method is also compared to several homogeneous ensembles and performs notably better. Our findings suggest that the improvements are even more significant on larger datasets.
Databáze: Directory of Open Access Journals