Theoretical Characterization of Deep Neural Networks
| Autor: | Piyush Kaul, Brejesh Lall |
|---|---|
| Rok vydání: | 2019 |
| Předmět: |
Quantitative Biology::Neurons and Cognition
Artificial neural network Computer science business.industry Computer Science::Neural and Evolutionary Computation Curvature Viewpoints Characterization (materials science) Task (project management) Variety (cybernetics) ComputingMethodologies_PATTERNRECOGNITION Pattern recognition (psychology) Deep neural networks Artificial intelligence business |
| Zdroj: | Deep Learning: Concepts and Architectures ISBN: 9783030317553 |
| DOI: | 10.1007/978-3-030-31756-0_2 |
| Popis: | Deep neural networks are poorly understood mathematically, however there has been a lot of recent work focusing on analyzing and understanding their success in a variety of pattern recognition tasks. We describe some of the mathematical techniques used for characterization of neural networks in terms of complexity of classification or regression task assigned, or based on functions learned, and try to relate this to architecture choices for neural networks. We explain some of the measurable quantifiers that can been used for defining expressivity of neural network including using homological complexity and curvature. We also describe neural networks from the viewpoints of scattering transforms and share some of the mathematical and intuitive justifications for those. We finally share a technique for visualizing and analyzing neural networks based on concept of Riemann curvature. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|