Training Neural Networks by Adaptive Random Search Techniques
Autor: | Anastasios Chassiakos, Thomas K. Caughey, Andrew W. Smyth, Mitsuru Nakamura, Sami F. Masri |
---|---|
Rok vydání: | 1999 |
Předmět: |
Artificial neural network
Stochastic process business.industry Computer science Mechanical Engineering System identification Machine learning computer.software_genre Stochastic programming Random search Mechanics of Materials Search algorithm Adaptive system Stochastic optimization Artificial intelligence business Algorithm computer |
Zdroj: | Journal of Engineering Mechanics. 125:123-132 |
ISSN: | 1943-7889 0733-9399 |
DOI: | 10.1061/(asce)0733-9399(1999)125:2(123) |
Popis: | A relatively simple stochastic optimization procedure based on the adaptive random search algorithm is presented to train artificial neural networks of the type encountered in applied mechanics applications. After discussing some essential features of the algorithm that influence its search efficiency, a procedure is outlined for replacing the back-propagation training approach by the new method in order to train networks involving high-dimensional parameter vectors. The method is successfully used in conjunction with a multilayer network involving a parameter vector of very high dimension. It is shown that the adaptive random search approach shifts the training effort from the user to the computer by exchanging additional computer search effort for easier training tasks on the part of the user. Extensive simulation studies are presented to provide statistically significant results related to the characteristics of the stochastic training approach. Guidelines are provided for applying the method to generi... |
Databáze: | OpenAIRE |
Externí odkaz: |