Learning In Linear Neural Networks - The Validity Of The Annealed Approximation
PHYSICAL REVIEW A(1992)
摘要
A statistical-mechanics approach has been recently used to develop a theoretical framework to describe the process of supervised learning and the emergence of generalization ability in layered neural networks. This theory has yielded a powerful tool: a recursion relation that predicts the generalization ability of trained networks as a function of the size of the training set. The recursion relation results from an annealed approximation to the correct quenched averaging over all possible training sets of fixed size. Here we investigate a simple learning problem for which both the quenched and annealed calculations are performed analytically. Comparison between the corresponding results establishes the range of validity of the annealed approximation.
更多查看译文
关键词
neural network,statistical physics,thermodynamics,statistical mechanics,supervised learning
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络