Trust-Region Learning For Ica
2004 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, PROCEEDINGS(2004)
摘要
A trust-region method is a quite attractive optimization technique, which finds a direction and a step size in an efficient and reliable manner with the help of a quadratic model of the objective function. It is, in general, faster than the steepest descent method and is free of a pre-selected constant learning rate. In addition to its convergence property (between linear and quadratic convergence), its stability is always guaranteed, in contrast to the Newton's method. In this paper, we present an efficient implementation of the maximum likelihood independent component analysis (ICA) using the trust-region method, which leads to trust-region-based ICA (TR-ICA) algorithms. The useful behavior of our TR-ICA algorithms is confirmed through numerical experimental results.
更多查看译文
关键词
stability,entropy,vectors,quadratic convergence,maximum likelihood,convergence,maximum likelihood estimation,statistical analysis,trust region,newton method,objective function,steepest descent method,mutual information,computer science,independent component analysis,learning artificial intelligence
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络