Statistical analysis of a two-layer backpropagation algorithm used for modeling nonlinear memoryless channels: the single neuron case
| Autor: | M. Ibnkahla, Francis Castanie, Neil J. Bershad |
|---|---|
| Rok vydání: | 1997 |
| Předmět: |
Training set
Artificial neural network Mean squared error business.industry Computer science Gaussian Monte Carlo method Backpropagation symbols.namesake Nonlinear system medicine.anatomical_structure Signal Processing symbols medicine Neuron Artificial intelligence Electrical and Electronic Engineering business Gaussian process Algorithm |
| Zdroj: | IEEE Transactions on Signal Processing. 45:747-756 |
| ISSN: | 1053-587X |
| DOI: | 10.1109/78.558493 |
| Popis: | Neural networks have been used for modeling the nonlinear characteristics of memoryless nonlinear channels using backpropagation (BP) learning with experimental training data. In order to better understand this neural network application, this paper studies the transient and convergence properties of a simplified two-layer neural network that uses the BP algorithm and is trained with zero mean Gaussian data. The paper studies the effects of the neural net structure, weights, initial conditions, and algorithm step size on the mean square error (MSE) of the neural net approximation. The performance analysis is based on the derivation of recursions for the mean weight update that can be used to predict the weights and the MSE over time. Monte Carlo simulations display good to excellent agreement between the actual behavior and the predictions of the theoretical model. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|