Gradient directions and relative inexactness in optimization and machine learning

Autor:	Vasin, Artem
Rok vydání:	2024
Předmět:	Mathematics - Optimization and Control
Druh dokumentu:	Working Paper
Popis:	In this paper, we investigate the influence of noise giving an estimate of the gradient having a acute angle with the original. Noise amplitude has a relative model. The work offers both theoretical calculations and theorems, as well as experimental results. Classic machine learning problems were chosen as experiments -- linear and logistic regression, computer vision and natural language processing.
Databáze:	arXiv
Externí odkaz:	http://arxiv.org/abs/2407.00667 Zobrazit plný text záznamu View this record from Arxiv