Robuta

https://openreview.net/forum?id=pFyXqxChZc IntSGD: Adaptive Floatless Compression of Stochastic Gradients | OpenReview We propose a family of adaptive integer compression operators for distributed Stochastic Gradient Descent (SGD) that do not communicate a single float. This is... adaptivefloatlesscompressionstochasticgradients