https://openreview.net/forum?id=JimfKP7qrU
Steepest Descent in the Modular Norm | OpenReview
An old idea in optimization theory says that since the gradient is a dual vector it may not be subtracted from the weights without first being mapped to the...
steepest descentin themodularnormopenreview