LightNets: The Concept of Weakening Layers
| Autor: | Feng Yang, Daojun Liang, Xiaohui Ju |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2019 |
| Předmět: |
Mechine learning
Network architecture General Computer Science Computer science Generalization General Engineering Inference deep learning 02 engineering and technology 010501 environmental sciences Residual 01 natural sciences Regularization (mathematics) computer vision Computer engineering Stack (abstract data type) 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing General Materials Science lcsh:Electrical engineering. Electronics. Nuclear engineering Electrical and Electronic Engineering Layer (object-oriented design) lcsh:TK1-9971 0105 earth and related environmental sciences |
| Zdroj: | IEEE Access, Vol 7, Pp 82231-82237 (2019) |
| ISSN: | 2169-3536 |
| Popis: | Deep neural networks generally use the information fusion at the front and back layers because the traditional convolutional networks that stack convolutional layers have limited ability to extract the effective information or effective information cannot be passed to the back layer. These networks, which incorporate the information of the previous layer, are attributed to the improvement of the accuracy achieved to facilitate the propagation of gradients and incorporate various techniques for adjusting parameters. We have explored the relationship between the residual networks and dense networks and found that they have a great degree of similarity in certain situations and can combine them to exert their respective advantages. We propose a lightweight network (LightNets) architecture with few parameters. LightNets has faster training and inference speeds because it has fewer parameters. The main way to explore is to change the flow and integration of information. This paper compares various network architectures and regularization techniques to analyze the generalization capabilities of the LightNets. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|