TheBloke
/

Mistral-7B-Instruct-v0.2-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Resources

View closed (2)

Issue: Dependency Conflicts When Using GPTQ Model with transformers Pipeline

#7 opened 5 months ago by

weights not used when initializing MistralForCausalLM

#6 opened 12 months ago by

Are Bloke's models usually slow on Kaggle?

#4 opened over 1 year ago by

Strange response

#3 opened almost 2 years ago by

Is it supports the chat template?

#1 opened almost 2 years ago by