Efficient learning for decomposing and optimizing random networks

In this study, we consider the problem of node ranking in a random network. A Markov chain is defined for the network, and its transition probability matrix is unknown but can be learned by sampling random interactions among nodes. Our objective is to decompose the Markov chain into several ergodic classes and select the best node in each ergodic class. We propose a dynamic sampling procedure, which gives a probability guarantee on correct decomposition and maximizes a weighted probability of correct selection of the best node in each ergodic class. Numerical experiment results demonstrate the efficiency of the proposed sampling procedure.