LVR
Low Variance Regularization
Method introduces a novel unlabeled debiasing technique which works on classification task to reduce the bias of the transformer based language models on downstream classification task. In their method authors use the classes as metric for regularization and punish the network if the embedding produced by the model are far from each other. by doing so the authors claim to be able to reduce the domain shift caused by any unwanted attribute information hence results in fair embedding.
Unlabeled Debiasing in Downstream Tasks via Class-wise Low Variance Regularization
https://paperswithcode.com/paper/unlabeled-debiasing-in-downstream-tasks-via
Unlabeled Debiasing in Downstream Tasks via Class-wise Low Variance Regularization