Solved the problem with this solution: https://huggingface.co/static-proxy/discuss.huggingface.co/t/fine-tune-for-multiclass-or-multilabel-multiclass/4035/8