Regularized Kernel Forms of Minimum Squared Error Method
| Autor: | LI Yan-da, Zhang Xue-gong, XU Jian-hua |
|---|---|
| Rok vydání: | 2006 |
| Předmět: |
Support vector machine
Mathematical optimization Nonlinear system Mean squared error Kernel (statistics) Probabilistic logic Regularization perspectives on support vector machines Applied mathematics Regression analysis Electrical and Electronic Engineering Regularization (mathematics) Electronic Optical and Magnetic Materials Mathematics |
| Zdroj: | Frontiers of Electrical and Electronic Engineering in China. 1:1-7 |
| ISSN: | 1673-3584 1673-3460 |
| DOI: | 10.1007/s11460-005-0011-y |
| Popis: | Minimum squared error (MSE) algorithm is one of the classical pattern recognition and regression analysis methods, whose objective is to minimize the squared error summation between the output of linear function and the desired output. In this paper, the MSE algorithm is modified by using kernel functions satisfying the Mercer condition and regularization technique; and the nonlinear MSE algorithms based on kernels and regularization term, that is, the regularized kernel forms of MSE algorithm, are proposed. Their objective functions include the squared error summation between the output of nonlinear function based on kernels and the desired output and a proper regularization term. The regularization technique can handle ill-posed problems, reduce the solution space, and control the generalization. Three squared regularization terms are utilized in this paper. In accordance with the probabilistic interpretation of regularization terms, the difference among three regularization terms is given in detail. The synthetic and real data are used to analyze the algorithm performance. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
Full text from SpringerLink