Shifted Softplus
Shifted Softplus
**Shifted Softplus** is an activation function ${\rm ssp}(x) = \ln( 0.5 e^{x} + 0.5 )$, which [SchNet](https://paperswithcode.com/method/schnet) employs as non-linearity throughout the network in order to obtain a smooth potential energy surface. The shifting ensures that ${\rm ssp}(0) = 0$ and improves the convergence of the network. This activation function shows similarity to ELUs, while having infinite order of continuity.
SchNet: A continuous-filter convolutional neural network for modeling quantum interactions
https://paperswithcode.com/paper/schnet-a-continuous-filter-convolutional
SchNet: A continuous-filter convolutional neural network for modeling quantum interactions