Normalized Gradients for All

Autor: Orabona, Francesco
Rok vydání: 2023
Předmět:
Druh dokumentu: Working Paper
Popis: In this short note, I show how to adapt to H\"{o}lder smoothness using normalized gradients in a black-box way. Moreover, the bound will depend on a novel notion of local H\"{o}lder smoothness. The main idea directly comes from Levy [2017].
Databáze: arXiv