SLAMB
Sparse Layer-wise Adaptive Moments optimizer for large Batch training
Please enter a description about the method here
SLAMB: Accelerated Large Batch Training with Sparse Communication
https://paperswithcode.com/paper/slamb-accelerated-large-batch-training-with
SLAMB: Accelerated Large Batch Training with Sparse Communication