Soups
Model Soups
Compress an ensemble of models into a single one by averaging their weights (under certain pre-conditions).
Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time
https://paperswithcode.com/paper/model-soups-averaging-weights-of-multiple
Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time