The model loading process requires the config file of openai/whisper-medium
#2
by rootikun - opened
The model loading process requires the config file of openai/whisper-medium, but it is not included in the downloaded model directory. Therefore, you need to download the config separately from openai/whisper-medium.
"model_type": "ser-whisper-ecapa",
"num_emotions": 7,
"pooling_type": "hybrid",
"sampling_rate": 16000,
"torch_dtype": "float32",
"transformers_version": "4.49.0",
"use_weighted_sum": false,
"whisper_name": "openai/whisper-medium"
Thanks for your interest in the model. This may be due to different version of transformer lib. The example worked well and it downloads all the required models and config. I tested with transformers version 4.46.3, however, it should work on any new transformer lib package as well.