Improved Neural Networks Based on Mutual Information via Information Geometry

Autor: Zhenhu Ning, Ya-Hao Zhang, Meng Wang, Jin Pang, Chuangbai Xiao, Jing Yu
Jazyk: angličtina
Rok vydání: 2019
Předmět:
Zdroj: Algorithms, Vol 12, Iss 5, p 103 (2019)
Algorithms
Volume 12
Issue 5
ISSN: 1999-4893
Popis: This paper presents a new algorithm based on the theory of mutual information and information geometry. This algorithm places emphasis on adaptive mutual information estimation and maximum likelihood estimation. With the theory of information geometry, we adjust the mutual information along the geodesic line. Finally, we evaluate our proposal using empirical datasets that are dedicated for classification and regression. The results show that our algorithm contributes to a significant improvement over existing methods.
Databáze: OpenAIRE
Nepřihlášeným uživatelům se plný text nezobrazuje