#Distributed-data-parallel

Showing 1 of 1 repositories tagged #distributed-data-parallel, ranked by stars

pytorch-transformer-distributed

Distributed training (multi-node) of a Transformer model

★ 99 ⑂ 43 —

Related Topics

#collective-communication #data-parallelism #deep-learning #distributed-training #gradient-accumulation #machine-learning #model-parallelism #pytorch #tutorial