Distributed Recurrent Neural Network Learning via Metropolis-Weights Consensus

When data are shared among arbitrarily connected machines, the training process became an interesting challenge where each node is initialized with a specific scalar value, so it present a problem of computing their average taking into account interconnectivity between agents in order to ensure that the objective process converges as the ...More