Gabriel Peyré

Muon framework offers new spectral Wasserstein distances for deep learning

Researchers have introduced a new framework called Muon to stabilize deep-learning optimization using spectral normalizations, particularly for matrix-shaped parameters. This work idealizes the continuous-time, vanishin…