Current CUDA Device does not support bfloat16. Please switch dtype to float16.

by marcos777123 - opened Nov 7, 2024

Olá,

cuda version é 12.1 e cudnn 8.9.7
coloquei: model_dtype, torch_dtype = 'bf16', torch.float16 #torch.bfloat16
e está indo...

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment