Local SGD
Local SGD
**Local SGD** is a distributed training technique that runs [SGD](https://paperswithcode.com/method/sgd) independently in parallel on different workers and averages the sequences only once in a while.
Local SGD Converges Fast and Communicates Little
https://paperswithcode.com/paper/local-sgd-converges-fast-and-communicates
Local SGD Converges Fast and Communicates Little