A new perspective for Minimal Learning Machines: A lightweight approach
| Autor: | Ajalmar R. da Rocha Neto, João P. P. Gomes, Saulo A. F. Oliveira, José A. V. Florêncio |
|---|---|
| Rok vydání: | 2020 |
| Předmět: |
0209 industrial biotechnology
Computer science business.industry Process (engineering) Cognitive Neuroscience Mean squared prediction error Perspective (graphical) 02 engineering and technology Machine learning computer.software_genre Computer Science Applications 020901 industrial engineering & automation Artificial Intelligence 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing Artificial intelligence business computer Selection (genetic algorithm) |
| Zdroj: | Neurocomputing. 401:308-319 |
| ISSN: | 0925-2312 |
| DOI: | 10.1016/j.neucom.2020.03.088 |
| Popis: | This paper introduces a new procedure to train Minimal Learning Machines (MLM) for regression tasks. Besides that, we propose a new prediction process in MLM. A well-known drawback concerning the (original) MLM model formulation is the lack of sparseness.The most recent efforts on this problem strongly rely on the selection of reference points before training and prediction steps in MLM, all based on some supposition regarding the data. In the opposite direction, here, we explore another formulation of MLM in which we do not rely on any assumption regarding the data for prior selection. Instead, our proposal, named Lightweight Minimal Learning Machine (LW-MLM), builds a regularized system that imposes sparseness. We thrive in such a sparse criterion, not by selection but instead using a piece of weighted information into the model. We validate the contributions of this paper through four types of experiments to evaluate different aspects of our proposal: the prediction error performance, the goodness-of-fit of estimated vs. measured values, the norm values which are related to the sparsity, and finally, the prediction error in high dimensional settings. Based on the results, we show that LW-MLM is a valid alternative since achieved similar or higher accuracy rates against other variants being all seen as statistically equivalent. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
Full Text from ScienceDirect