Do We Really Need a New Theory to Understand Over-Parameterization?

•Our ability to understand the mechanism behind the ML breakthroughs has slowed down.•We question the necessity for a new theoretical framework able to fill this lack.•We focus on over-parametrization a peculiar mechanism to increase generalization.•Over-parametrization can be understood using known theories and empirical evidences.