Newton's method

Spectral optimizers like Muon show sharp capacity scaling in associative memory tasks

A new paper analyzes the performance of spectral optimizers, like Muon, in training large language models by examining their effectiveness in learning associative memory. The research demonstrates that Muon significantl…