ShiLU
Shifted Rectified Linear Unit
The **Shifted Rectified Linear Unit**, or **ShiLU**, is a modification of **[ReLU](https://paperswithcode.com/method/relu)** activation function that has trainable parameters.

$$ShiLU(x) = \alpha ReLU(x) + \beta$$
Trainable Activations for Image Classification
https://paperswithcode.com/paper/trainable-activations-for-image
Trainable Activations for Image Classification