A Random Fourier Features Perspective of KAFs With Application to Distributed Learning Over Networks
| Autor: | Sergios Theodoridis, Symeon Chouvardas, Pantelis Bouboulis |
|---|---|
| Rok vydání: | 2018 |
| Předmět: |
021103 operations research
Theoretical computer science Euclidean space Computer science 0211 other engineering and technologies Hilbert space 020206 networking & telecommunications 02 engineering and technology symbols.namesake Fourier transform Kernel (statistics) 0202 electrical engineering electronic engineering information engineering symbols sort Pruning (decision trees) Limit (mathematics) Linear search |
| DOI: | 10.1016/b978-0-12-812976-0.00009-9 |
| Popis: | A major problem in any typical online kernel-based scheme is that the model's solution is given as an expansion of kernel functions that grows linearly with time. Usually, some sort of pruning strategy is adopted to make the solution sparse for practical reasons. The key idea is to keep the most informative training data in the expansion (the so-called dictionary), while the rest is omitted. Although these strategies have been proven effective, they still consume computational resources due to their nature (e.g., they require a sequential search of the dictionary at each time instant) and they limit the design of kernel-based methods in more general settings, as for example in distributed systems. In this chapter, we show how one can employ random features of the kernel function to transform the original nonlinear problem, which lies in an infinite-dimensional Hilbert space, to a fixed-dimension Euclidean space, without significantly compromising performance. This paves the way for designing kernel-based methods for distributed systems based on their linear counterparts. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|