Density Plots of Hidden Value Unit Activations Reveal Interpretable Bands

Autor:	Michael Dawson, Lorraine Porcello
Rok vydání:	1995
Předmět:	Artificial neural network Computer science Gaussian Activation function Value (computer science) Context (language use) Backpropagation Human-Computer Interaction Set (abstract data type) symbols.namesake Connectionism Artificial Intelligence symbols Algorithm Software
Zdroj:	Connection Science. 7:167-187
ISSN:	1360-0494 0954-0091
Popis:	A particular backpropagation network, called a network of value units, was trained to detect problem type and validity of a set of logic problems. This network differs from standard networks in using a Gaussian activation function. After training was successfully completed, jittered density plots were computed for each hidden unit, and used to represent the distribution of activations produced in each hidden unit by the entire training set. The density plots revealed a marked banding. Further analysis revealed that almost all of these bands could be assigned featural interpretations, and played an important role in explaining how the network classified input patterns. These results are discussed in the context of other techniques for analyzing network structure, and in the context of other parallel distributed processing architectures.
Databáze:	OpenAIRE
Externí odkaz:	https://explore.openaire.eu/search/publication?articleId=doi_________::96576578c867bf17aedf9fc85964c076 https://doi.org/10.1080/09540099550039336 Zobrazit plný text záznamu