Sam Babichenko

Reading notes

Lazy training and feature learning

Infinite-width limits of neural networks in which the features stay fixed or move.

The neural tangent kernelJacot et al., 2018; Chizat et al., 20198 questions Mean-field limits of two-layer networksMei et al., 20188 questions Maximal update parametrizationYang and Hu, 20218 questions