A Mean Field View of the Landscape of Two-Layers Neural Networks

Proceedings of the National Academy of Sciences of the United States of America, Volume abs/1804.06561, Issue 33, 2018, Pages 201806579

Cited by: 23|Bibtex|Views11|Links
EI WOS
Keywords:
Wasserstein spacegradient flowneural networkspartial differential equationsstochastic gradient descent

Abstract:

Multilayer neural networks are among the most powerful models in machine learning, yet the fundamental reasons for this success defy mathematical understanding. Learning a neural network requires optimizing a nonconvex high-dimensional objective (risk function), a problem that is usually attacked using stochastic gradient descent (SGD). D...More

Code:

Data:

Your rating :
0

 

Tags
Comments