Abstract:Based on the analysis of the internal relation between learning ability and generalization ability of the overfitting of BP neural network,by the introduction of mulit-correlative coefficient to manifest the complexity of the function,a quantitative uncertainty relation between the fitting relative error of training sample sets and the testing relative error of verifying sample sets,which describe the learning ability and the generalization ability of BP network,respectively,was revealed in the overfitting of BP neural network.Tests of numerical simulation for multi-kinds of different functions were carried out to determine the value distribution (0.007~0.07)of overfitting parameter q in the relation.Based on the quantitative relation,the training method for the improvement of generalization ability in the training process of sample sets using BP neural network was given.
李祚泳;易勇鸷. BP网络学习能力与泛化能力之间的定量关系式[J]. 电子学报, 2003, 31(9): 1341-1344.
LI Zuo-yong;YI Yong-zhi. Quantitative Relation Between Learning Ability and Generalization Ability of BP Neural Network. Chinese Journal of Electronics, 2003, 31(9): 1341-1344.