Analysis of Bayesian Inference Algorithms by the Dynamical Functional Approach

JOURNAL OF PHYSICS A-MATHEMATICAL AND THEORETICAL(2020)

引用 7|浏览14
暂无评分
摘要
We analyze the dynamics of an algorithm for approximate inference with large Gaussian latent variable models in a student-teacher scenario. To model nontrivial dependencies between the latent variables, we assume random covariance matrices drawn from rotation invariant ensembles. For the case of perfect data-model matching, the knowledge of static order parameters derived from the replica method allows us to obtain efficient algorithmic updates in terms of matrix-vector multiplications with a fixed matrix. Using the dynamical functional approach, we obtain an exact effective stochastic process in the thermodynamic limit for a single node. From this, we obtain closed-form expressions for the rate of the convergence. Analytical results are in excellent agreement with simulations of single instances of large models.
更多
查看译文
关键词
Bayesian inference,iterative algorithms,TAP equations,random matrices,dynamical functional theory
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络