inference-optimization/Llama-3.1-8B-Instruct-NVFP4
5B • Updated • 7 • 1
nvfp4-llama3.1-8b-ablations
-
-
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-GPTQ-BlockSize16
5B • Updated • 10 • 1 -
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-GPTQ
5B • Updated • 9 -
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-GPTQ-SmoothQuant
5B • Updated • 7 -
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-SmoothQuant
5B • Updated • 6