relaxml
/

Llama-2-13b-E8PRVQ-4Bit

Text Generation

text-generation-inference

Model card Files Files and versions

No model card

Downloads last month: 9

Safetensors

Model size

1B params

Tensor type

I64

·

F16

·

Collection including relaxml/Llama-2-13b-E8PRVQ-4Bit

QuIP# Quantized Models

https://github.com/Cornell-RelaxML/quip-sharp • 16 items • Updated 3 days ago • 3