Revisiting hierarchy: Deep learning with orthogonally constrained prior for classification
| Autor: | Gang Chen, Sargur N. Srihari |
|---|---|
| Rok vydání: | 2020 |
| Předmět: |
Training set
Contextual image classification Computer science business.industry Deep learning 02 engineering and technology Overfitting Machine learning computer.software_genre 01 natural sciences Support vector machine Categorization Artificial Intelligence 0103 physical sciences Signal Processing 0202 electrical engineering electronic engineering information engineering Leverage (statistics) 020201 artificial intelligence & image processing Computer Vision and Pattern Recognition Artificial intelligence 010306 general physics business computer Software |
| Zdroj: | Pattern Recognition Letters. 140:214-221 |
| ISSN: | 0167-8655 |
| DOI: | 10.1016/j.patrec.2020.10.006 |
| Popis: | Deep learning has attracted significant attention for its applications to a variety of classification problems, such as handwritten recognition, image classification and document categorization. One reason behind the success of deep learning can be attributed to its strong representation power with multiple layers of hidden variables. However, complex models are often encompassed with overfitting problems when limited training data is available. In this paper, we are interested in deep learning for classification with prior, where the set of labels are expressed in a hierarchy. In particular, we attempt to leverage knowledge transfer and parameter sharing among classes. We introduce the orthogonally constrained prior into deep learning, which exploits the following information among different classes: (1) introduce weight decomposition to model parameter sharing along the path from the root to leafs; (2) incorporate the orthogonal restrictions among adjacent nodes in the hierarchy. We test our method on challenge datasets in the case of a few training examples available, and show promising results compared to support vector machines and other deep learning methods. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
Full Text from ScienceDirect