YANG Jie, SUN Ya-dong, ZHANG Liang-jun, et al. Weakly Supervised Learning with Denoising Restricted Boltzmann Machines for Extracting Features[J]. Acta Electronica Sinica, 2014, 42(12): 2365-2370.
DOI:
YANG Jie, SUN Ya-dong, ZHANG Liang-jun, et al. Weakly Supervised Learning with Denoising Restricted Boltzmann Machines for Extracting Features[J]. Acta Electronica Sinica, 2014, 42(12): 2365-2370. DOI: 10.3969/j.issn.0372-2112.2014.12.005.
Weakly Supervised Learning with Denoising Restricted Boltzmann Machines for Extracting Features
Existing feature extraction algorithms are difficult to capture useful information from complex images.A feature extraction approach is proposed based on the weakly supervised learning with denoising restricted Boltzmann machine(RBM).First
a standard RBM is pre-trained in an unsupervised learning way
which provides a hierarchical mode with a visible layer and a hidden layer.Second
for the visible layer
a stochastic binary switch node is employed.And for the hidden layer
it is divided into foreground-hidden nodes and background-hidden nodes based on the score of each hidden node's activation values and times
thus we can achieve a binary mixture denoising RBMs.Finally
the pixel-wise denoising RBMs is trained by using small number label information and stochastic switch nodes through multiplicative interaction.The experimental results show that significant performance improvement is achieved with our proposed method.