Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9

Full-text search

Active filters: w4a4

zzzmahesh/Meta-Llama-3-8B-Instruct-quantized.w4a4

Text Generation • 8B • Updated Sep 3, 2024 • 34 • 1

ussoewwin/Hybrid-Sensitivity-Weighted-Quantization-SDXL-fp8e4m3

Text-to-Image • Updated about 1 hour ago • 5

JongYeop/Llama-3.1-8B-Instruct-NVFP4-W4A4

5B • Updated Jan 29

JongYeop/Llama-3.1-70B-Instruct-NVFP4-W4A4

41B • Updated Feb 2 • 10

ussoewwin/HSWQ-Z-Image-fp8e4m3

Text-to-Image • Updated 5 days ago • 1

JongYeop/Qwen2.5-VL-3B-Instruct-FP4-W4A4-LM-Only

Image-Text-to-Text • 3B • Updated 12 days ago • 21

JongYeop/Qwen2.5-VL-7B-Instruct-FP4-W4A4-LM-Only

Image-Text-to-Text • 5B • Updated 12 days ago • 27

JongYeop/Qwen2.5-VL-3B-Instruct-MXFP4-W4A4-LM-Only

Image-Text-to-Text • 2B • Updated about 19 hours ago

JongYeop/Qwen2.5-VL-7B-Instruct-MXFP4-W4A4-LM-Only

Image-Text-to-Text • 5B • Updated about 19 hours ago