Gradient Checkpointing
Gradient Checkpointing
**Gradient Checkpointing** is a method used for reducing the memory footprint when training deep neural networks, at the cost of having a small increase in computation time.
Training Deep Nets with Sublinear Memory Cost
https://paperswithcode.com/paper/training-deep-nets-with-sublinear-memory-cost
Training Deep Nets with Sublinear Memory Cost