Fraternal Dropout
Fraternal Dropout
**Fraternal Dropout** is a regularization method for recurrent neural networks that trains two identical copies of an RNN (that share parameters) with different [dropout](https://paperswithcode.com/method/dropout) masks while minimizing the difference between their (pre-[softmax](https://paperswithcode.com/method/softmax)) predictions. This encourages the representations of RNNs to be invariant to dropout mask, thus being robust.
Fraternal Dropout
https://paperswithcode.com/paper/fraternal-dropout
Fraternal Dropout