Fine-Grained Analysis of Optimization and Generalization for Overparameterized Two-Layer Neural Networks
International Conference on Machine Learning, pp. 322-332, 2019.
Recent works have cast some light on the mystery of why deep nets fit any data and generalize despite being very overparametrized. This paper analyzes training and generalization for a simple 2-layer ReLU net with random initialization, and provides the following improvements over recent works: (i) Using a tighter characterization of trai...More
PPT (Upload PPT)