Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

5,297

Full-text search

Active filters: quantized

Ex0bit/Elbaz-NVIDIA-Nemotron-3-Nano-30B-A3B-PRISM

Text Generation • 32B • Updated Jan 23 • 4.28k • 23

nvidia/Qwen3-235B-A22B-Thinking-2507-NVFP4

Text Generation • Updated 26 days ago • 753 • 5

RedHatAI/granite-4.0-h-tiny-FP8-dynamic

Text Generation • 7B • Updated about 19 hours ago • 384 • 2

GadflyII/GLM-4.7-Flash-NVFP4

Text Generation • Updated Jan 20 • 246k • 64

3ndetz/LTX2-Rapid-Merges-GGUF

Image-Text-to-Video • 19B • Updated 22 days ago • 10.2k • 20

vincentzed-hf/Qwen3-Coder-Next-NVFP4

Text Generation • Updated 9 days ago • 6.33k • 7

huawei-csl/Qwen3-0.6B-PreSINQ-GGUF

Text Generation • 0.6B • Updated 15 days ago • 79 • 2

huawei-csl/Qwen3-1.7B-PreSINQ-GGUF

Text Generation • 2B • Updated 15 days ago • 103 • 2

huawei-csl/Qwen3-4B-PreSINQ-GGUF

Text Generation • 4B • Updated 15 days ago • 150 • 5

inferencerlabs/GLM-5-MLX-5.6bit

Text Generation • Updated 12 days ago • 1.95k • 3

inferencerlabs/MiniMax-M2.5-MLX-9bit

Text Generation • 229B • Updated 12 days ago • 943 • 4

vistralis/FLUX.2-klein-9b-INT8-transformer

Text-to-Image • Updated 9 days ago • 56 • 2

Maklei/GLM-5-pruned-Q4_K_M-GGUF

387B • Updated about 22 hours ago • 7.14k • 2

inferencerlabs/Qwen3.5-397B-A17B-MLX-9bit

Text Generation • 396B • Updated 8 days ago • 4.16k • 6

steampunque/JoyAI-LLM-Flash-MP-GGUF

49B • Updated 3 days ago • 340 • 2

mradermacher/Step-3.5-Flash-Ablitirated-GGUF

197B • Updated 4 days ago • 1.11k • 2

mradermacher/Step-3.5-Flash-Ablitirated-i1-GGUF

197B • Updated 2 days ago • 7.2k • 2

olka-fi/Qwen3.5-122B-A10B-MXFP4

Text Generation • 71B • Updated about 2 hours ago • 6 • 2

afrideva/phi-2-uncensored-GGUF

Text Generation • 3B • Updated Dec 21, 2023 • 373 • 13

MaziyarPanahi/TinyLlama-1.1B-Chat-v1.0-GGUF

Text Generation • 1B • Updated Feb 4, 2024 • 302 • 2

AetherArchitectural/GGUF-Quantization-Script

Text Generation • Updated Aug 31, 2025 • 69

MaziyarPanahi/Mixtral-8x22B-Instruct-v0.1-AWQ

Text Generation • 141B • Updated Apr 18, 2024 • 40.2k • 13

afrideva/Tinystories-gpt-0.1-3m-GGUF

Text Generation • 6.96M • Updated May 12, 2024 • 348 • 7

MaziyarPanahi/Hermes-2-Pro-Llama-3-13B-GGUF

Text Generation • 12B • Updated Jun 15, 2024 • 99 • 1

legraphista/DeepSeek-Coder-V2-Lite-Instruct-IMat-GGUF

Text Generation • 16B • Updated Jun 17, 2024 • 671 • 9

MaziyarPanahi/Meta-Llama-3.1-405B-Instruct-GGUF

Text Generation • 410B • Updated Jul 29, 2024 • 108k • 16

argmaxinc/speakerkit-pro

Automatic Speech Recognition • Updated 9 days ago • 19

MaziyarPanahi/phi-4-GGUF

Text Generation • 15B • Updated Jan 8, 2025 • 109k • 6

MaziyarPanahi/gemma-3-12b-it-GGUF

Text Generation • 12B • Updated Mar 12, 2025 • 111k • 16

nvidia/Llama-4-Scout-17B-16E-Instruct-NVFP4

56B • Updated Dec 12, 2025 • 13.3k • 21