黄德双. On the Study of Transformation Properties of Hidden Units of Feedforward Neural Networks Classifiers[J]. Acta Electronica Sinica, 1998, (11): 99-103.
黄德双. On the Study of Transformation Properties of Hidden Units of Feedforward Neural Networks Classifiers[J]. Acta Electronica Sinica, 1998, (11): 99-103.DOI:
On the Study of Transformation Properties of Hidden Units of Feedforward Neural Networks Classifiers
This paper studies the transformation properties of hidden units of linear or nonlinear feedforward networks(FNN) classifiers. The mechanisms of how to organize information in the linear or nonlinear FNNs are disclosed. It is proved that the hidden output patterns in linear FNNs are correlated and the ones in nonlinear FNNs are decorrelated. Moreover
a theorem
which shows that the nonlinear networks break through the "bottleneck " in linear networks and obtain independent hidden outputs
is given. Finally
an example
i. c.
parity 3 problem
is used as the simulating data and the related experimental results are presented.