Measuring the usefulness of hidden units in Boltzmann machines with mutual information

Neural Networks, pp. 12-18, 2015.

Cited by: 14|Bibtex|Views49|Links
WOS EI
Keywords:
restricted boltzmann machinedeep boltzmann machinepruningdeep learningstructural learningMore(1+)

Abstract:

Restricted Boltzmann machines (RBMs) and deep Boltzmann machines (DBMs) are important models in deep learning, but it is often difficult to measure their performance in general, or measure the importance of individual hidden units in specific. We propose to use mutual information to measure the usefulness of individual hidden units in Bol...More

Code:

Data:

Your rating :
0

 

Tags
Comments