On Exact Computation with an Infinitely Wide Neural Net

Sanjeev Arora

[0]

[0]

[0]

[0]

[0]

[0]

ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), pp. 8139-8148, 2019.

Cited by: 253|Views455

Keywords:

convolutional neural networkgaussian processesinfinite width

Abstract:

How well does a classic deep net architecture like AlexNet or VGG19 classify on a standard dataset such as CIFAR-10 when its "width"-namely, number of channels in convolutional layers, and number of nodes in fully-connected internal layers - is allowed to increase to infinity? Such questions have come to the forefront in the quest to theo...More

Code:

Data:

Full Text