A Preliminary Approach to Semi-supervised Learning in Convolutional Neural Networks Applying 'Sleep-Wake' Cycles
| Autor: | Humberto Bustince, Andrew P. Paplinski, Mikel Elkano |
|---|---|
| Rok vydání: | 2017 |
| Předmět: |
Training set
Computer science Process (engineering) business.industry Deep learning Feature extraction Image processing Semi-supervised learning 010501 environmental sciences Machine learning computer.software_genre 01 natural sciences Convolutional neural network 03 medical and health sciences Generative model 0302 clinical medicine Artificial intelligence business Cluster analysis computer 030217 neurology & neurosurgery 0105 earth and related environmental sciences |
| Zdroj: | Neural Information Processing ISBN: 9783319700922 ICONIP (4) |
| DOI: | 10.1007/978-3-319-70093-9_49 |
| Popis: | The scarcity of labeled data has limited the capacity of convolutional neural networks (CNNs) until not long ago and still represents a serious problem in a number of image processing applications. Unsupervised methods have been shown to perform well in feature extraction and clustering tasks, but further investigation on unsupervised solutions for CNNs is needed. In this work, we propose a bio-inspired methodology that applies a deep generative model to help the CNN take advantage of unlabeled data and improve its classification performance. Inspired by the human “sleep-wake cycles”, the proposed method divides the learning process into sleep and waking periods. During the waking period, both the generative model and the CNN learn from real training data simultaneously. When sleep begins, none of the networks receive real data and the generative model creates a synthetic dataset from which the CNN learns. The experimental results showed that the generative model was able to teach the CNN and improve its classification performance. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|