Sparse Minimal Learning Machines Via L_1/2 Norm Regularization
| Autor: | Amauri H. Souza Júnior, Ananda L. Freire, João P. P. Gomes, Madson Luiz Dantas Dias, Ajalmar R. da Rocha Neto |
|---|---|
| Rok vydání: | 2018 |
| Předmět: |
Support vector machine
Minimal learning machine Computer science Linear regression 0202 electrical engineering electronic engineering information engineering 020206 networking & telecommunications 020201 artificial intelligence & image processing 02 engineering and technology Regularization (mathematics) Algorithm |
| Zdroj: | BRACIS |
| DOI: | 10.1109/bracis.2018.00043 |
| Popis: | The Minimal Learning Machine (MLM) is a supervised method in which learning consists of fitting a multiresponse linear regression model between distances computed from the input and output spaces. A critical issue related to the training process in MLMs is the selection of prototypes, also called reference points (RPs), from which distances are taken. In its original formulation, the MLM selects the RPs randomly from the data. In this paper we empirically show that the original random selection may lead to a poor generalization capability. In addition, we propose a novel pruning method for selecting RPs based on L_1/2 norm regularization. Our results show that the proposed method is able to outperform the original MLM and its variants. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|