Splitting Gaussian processes for computationally-efficient regression.

Autor: Nick Terry, Youngjun Choe
Jazyk: angličtina
Rok vydání: 2021
Předmět:
Zdroj: PLoS ONE, Vol 16, Iss 8, p e0256470 (2021)
Druh dokumentu: article
ISSN: 1932-6203
DOI: 10.1371/journal.pone.0256470
Popis: Gaussian processes offer a flexible kernel method for regression. While Gaussian processes have many useful theoretical properties and have proven practically useful, they suffer from poor scaling in the number of observations. In particular, the cubic time complexity of updating standard Gaussian process models can be a limiting factor in applications. We propose an algorithm for sequentially partitioning the input space and fitting a localized Gaussian process to each disjoint region. The algorithm is shown to have superior time and space complexity to existing methods, and its sequential nature allows the model to be updated efficiently. The algorithm constructs a model for which the time complexity of updating is tightly bounded above by a pre-specified parameter. To the best of our knowledge, the model is the first local Gaussian process regression model to achieve linear memory complexity. Theoretical continuity properties of the model are proven. We demonstrate the efficacy of the resulting model on several multi-dimensional regression tasks.
Databáze: Directory of Open Access Journals
Nepřihlášeným uživatelům se plný text nezobrazuje