Ensemble of Networks for Multilabel Classification

Autor: Loris Nanni, Luca Trambaiollo, Sheryl Brahnam, Xiang Guo, Chancellor Woolsey
Jazyk: angličtina
Rok vydání: 2022
Předmět:
Zdroj: Signals, Vol 3, Iss 4, Pp 911-931 (2022)
Druh dokumentu: article
ISSN: 2624-6120
DOI: 10.3390/signals3040054
Popis: Multilabel learning goes beyond standard supervised learning models by associating a sample with more than one class label. Among the many techniques developed in the last decade to handle multilabel learning best approaches are those harnessing the power of ensembles and deep learners. This work proposes merging both methods by combining a set of gated recurrent units, temporal convolutional neural networks, and long short-term memory networks trained with variants of the Adam optimization approach. We examine many Adam variants, each fundamentally based on the difference between present and past gradients, with step size adjusted for each parameter. We also combine Incorporating Multiple Clustering Centers and a bootstrap-aggregated decision trees ensemble, which is shown to further boost classification performance. In addition, we provide an ablation study for assessing the performance improvement that each module of our ensemble produces. Multiple experiments on a large set of datasets representing a wide variety of multilabel tasks demonstrate the robustness of our best ensemble, which is shown to outperform the state-of-the-art.
Databáze: Directory of Open Access Journals