Intel
/

bert-base-uncased-sparse-80-1x4-block-pruneofa

Model card Files Files and versions

bert-base-uncased-sparse-80-1x4-block-pruneofa / README.md

ofirzaf's picture

Update README.md

cafff37 about 4 years ago

|

History Blame Contribute Delete

552 Bytes

	---
	language: en
	license: apache-2.0
	tags:
	- fill-mask
	datasets:
	- wikipedia
	- bookcorpus
	---
	# 80% 1x4 Block Sparse BERT-Base (uncased) Prune OFA
	This model is was created using Prune OFA method described in [Prune Once for All: Sparse Pre-Trained Language Models](https://arxiv.org/abs/2111.05754) presented in ENLSP NeurIPS Workshop 2021.

	For further details on the model and its result, see our paper and our implementation available [here](https://github.com/IntelLabs/Model-Compression-Research-Package/tree/main/research/prune-once-for-all).