https://deepai.org/publication/tap-accelerating-large-scale-dnn-training-through-tensor-automatic-parallelisation
TAP: Accelerating Large-Scale DNN Training Through Tensor Automatic Parallelisation | DeepAI
Feb 1, 2023 - 02/01/23 - Model parallelism has become necessary to train large neural networks. However, finding a suitable model parallel schedule for an ...
large scalednn trainingautomatic parallelisationtapaccelerating