Deep Learning using Robust Interdependent Codes

We investigate a simple yet eective method to introduce inhibitory and excitatory in- teractions between units in the layers of a deep neural network classifier. The method is based on the greedy layer-wise procedure of deep learning algorithms and extends the denoising autoencoder (Vincent et al., 2008) by adding asymmetric lateral connections be- tween its hidden coding units, in ...