Convergence of online learning algorithm with a parameterized loss

Autor: Shuhua Wang
Jazyk: angličtina
Rok vydání: 2022
Předmět:
Zdroj: AIMS Mathematics, Vol 7, Iss 11, Pp 20066-20084 (2022)
Druh dokumentu: article
ISSN: 2473-6988
DOI: 10.3934/math.20221098?viewType=HTML
Popis: The research on the learning performance of machine learning algorithms is one of the important contents of machine learning theory, and the selection of loss function is one of the important factors affecting the learning performance. In this paper, we introduce a parameterized loss function into the online learning algorithm and investigate the performance. By applying convex analysis techniques, the convergence of the learning sequence is proved and the convergence rate is provided in the expectation sense. The analysis results show that the convergence rate can be greatly improved by adjusting the parameter in the loss function.
Databáze: Directory of Open Access Journals