Scaling Laws and Spectra of Shallow Neural Networks in the Feature Learning Regime
By Leonardo Defilippis, Yizhou Xu, Julius Girardin, Emanuele Troiani, Vittorio Erba, Lenka Zdeborov\'a, Bruno Loureiro and Florent Krzakala
Provides a systematic theoretical analysis of neural scaling laws for shallow networks (quadratic and diagonal) in the feature learning regime, deriving phase diagrams for scaling exponents and connecting them to spectral properties of trained weights. Bridges theory and empirical observations of scaling behavior in deep learning.