Knowledge Extraction of Adaptive Structural Learning of Deep Belief Network for Medical Examination Data
| Autor: | Toshihide Harada, Shin Kamada, Takumi Ichimura |
|---|---|
| Rok vydání: | 2019 |
| Předmět: |
0303 health sciences
Linguistics and Language Computer Networks and Communications business.industry Computer science Deep learning Network structure 02 engineering and technology Computer Science Applications 03 medical and health sciences Deep belief network Knowledge extraction Artificial Intelligence 0202 electrical engineering electronic engineering information engineering Structural learning 020201 artificial intelligence & image processing Artificial intelligence business Software 030304 developmental biology Information Systems |
| Zdroj: | International Journal of Semantic Computing. 13:67-86 |
| ISSN: | 1793-7108 1793-351X |
| DOI: | 10.1142/s1793351x1940004x |
| Popis: | Deep learning has a hierarchical network structure to represent multiple features of input data. The adaptive structural learning method of Deep Belief Network (DBN) can reach the high classification capability while searching the optimal network structure during the training. The method can find the optimal number of hidden neurons for given input data in a Restricted Boltzmann Machine (RBM) by neuron generation–annihilation algorithm, and generate a new hidden layer in DBN by the extension of the algorithm. In this paper, the proposed adaptive structural learning of DBN (Adaptive DBN) was applied to the comprehensive medical examination data for cancer prediction. The developed prediction system showed higher classification accuracy for test data (99.5% for the lung cancer and 94.3% for the stomach cancer) than the several learning methods such as traditional RBM, DBN, Non-Linear Support Vector Machine (SVM), and Convolutional Neural Network (CNN). Moreover, the explicit knowledge that makes the inference process of the trained DBN is required in deep learning. The binary patterns of activated neurons for given input in RBM and the hierarchical structure of DBN can represent the relation between input and output signals. These binary patterns were classified by C4.5 for knowledge extraction. Although the extracted knowledge showed slightly lower classification accuracy than the trained DBN network, it was able to improve inference speed by about 1/40. We report that the extracted IF-THEN rules from the trained DBN for medical examination data showed some interesting features related to initial condition of cancer. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|