adaptive learning rate - Robuta Search

https://www.overleaf.com/articles/adaptive-learning-rate-clipping-stabilizes-learning/tssrqcwknfch

Adaptive learning rate clipping (ALRC) stabilizes learning by limiting backpropagated losses.