Scaling laws

Spectrum-dependent learning curvesBordelon et al., 2020; Maloney et al., 20227 questions Explaining Neural Scaling LawsBahri et al., 20217 questions Chinchilla scalingHoffmann et al., 20227 questions 4+3 Phases of Compute-Optimal Neural Scaling LawsLin et al., 2024; Paquette et al., 20248 questions