Gono

GONO optimizer adapts Adam's momentum using directional consistency for better convergence

Researchers have introduced the GONO framework, an optimization signal designed to improve deep learning training by addressing the decoupling of directional alignment and loss convergence. Unlike existing optimizers th…