Margin ReLU
Margin Rectified Linear Unit
**Margin Rectified Linear Unit**, or **Margin ReLU**, is a type of activation function based on a [ReLU](https://paperswithcode.com/method/relu), but it has a negative threshold for negative values instead of a zero threshhold.
A Comprehensive Overhaul of Feature Distillation
https://paperswithcode.com/paper/a-comprehensive-overhaul-of-feature
A Comprehensive Overhaul of Feature Distillation