Subset based error recovery
| Autor: | Mustafa Ç. Pınar, Ömer Ekmekcioglu, Deniz Akkaya |
|---|---|
| Přispěvatelé: | Ekmekcioğlu, Ömer, Akkaya, Deniz, Pınar, Mustafa Çelebi |
| Rok vydání: | 2022 |
| Předmět: |
Lemma (mathematics)
Extreme learning machine Artificial neural network Computer science Noise (signal processing) Noise reduction Hard thresholding Robust regression Restricted isometry property Huber loss Sparse recovery Control and Systems Engineering Regularization Signal Processing Computer Vision and Pattern Recognition Electrical and Electronic Engineering Robust networks Algorithm Software |
| Zdroj: | Signal Processing |
| ISSN: | 0165-1684 |
| DOI: | 10.1016/j.sigpro.2021.108361 |
| Popis: | We propose a data denoising method using Extreme Learning Machine (ELM) structure which allows us to use Johnson-Lindenstraus Lemma (JL) for preserving Restricted Isometry Property (RIP) in order to give theoretical guarantees for recovery. Furthermore, we show that the method is equivalent to a robust two-layer ELM that implicitly benefits from the proposed denoising algorithm. Current robust ELM methods in the literature involve well-studied L1, L2 regularization techniques as well as the usage of the robust loss functions such as Huber Loss. We extend the recent analysis on the Robust Regression literature to be effectively used in more general, non-linear settings and to be compatible with any ML algorithm such as Neural Networks (NN). These methods are useful under the scenario where the observations suffer from the effect of heavy noise. We extend the usage of ELM as a general data denoising method independent of the ML algorithm. Tests for denoising and regularized ELM methods are conducted on both synthetic and real data. Our method performs better than its competitors for most of the scenarios, and successfully eliminates most of the noise. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
Full Text from ScienceDirect