PipeMare
PipeMare
**PipeMare** is an asynchronous (bubble-free) pipeline parallel method for training large neural networks. It involves two main techniques: learning rate rescheduling and discrepancy correction.
PipeMare: Asynchronous Pipeline Parallel DNN Training
https://paperswithcode.com/paper/pipemare-asynchronous-pipeline-parallel-dnn
PipeMare: Asynchronous Pipeline Parallel DNN Training