Zoneout
Zoneout
**Zoneout** is a  method for regularizing [RNNs](https://paperswithcode.com/methods/category/recurrent-neural-networks). At each timestep, zoneout stochastically forces some hidden units to maintain their previous values. Like [dropout](https://paperswithcode.com/method/dropout), zoneout uses random noise to train a pseudo-ensemble, improving generalization.
But by preserving instead of dropping hidden units, gradient information and state information are more readily propagated through time, as in feedforward [stochastic depth](https://paperswithcode.com/method/stochastic-depth) networks.
Zoneout: Regularizing RNNs by Randomly Preserving Hidden Activations
https://paperswithcode.com/paper/zoneout-regularizing-rnns-by-randomly
Zoneout: Regularizing RNNs by Randomly Preserving Hidden Activations