Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,466

Full-text search

Active filters: chat

lmstudio-community/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • 8B • Updated Sep 19, 2024 • 8.7k • 20

mlx-community/Qwen2.5-Coder-7B-Instruct-4bit

Text Generation • Updated Sep 18, 2024 • 2.71k • 8

Qwen/Qwen2.5-Coder-7B-Instruct-GPTQ-Int4

Text Generation • 8B • Updated Nov 18, 2024 • 846k • 13

anthracite-org/magnum-v4-123b

Text Generation • 123B • Updated Nov 25, 2024 • 252 • 31

taobao-mnn/phi-2-MNN

Text Generation • Updated Dec 31, 2024 • 65 • 2

anthracite-org/magnum-v4-9b-gguf

Text Generation • 9B • Updated Nov 25, 2024 • 210 • 17

huihui-ai/Qwen2.5-32B-Instruct-abliterated

Text Generation • Updated Apr 28, 2025 • 12.6k • • 53

huihui-ai/Qwen2.5-Coder-7B-Instruct-abliterated

Text Generation • 8B • Updated Nov 25, 2024 • 928 • 9

anthracite-org/magnum-v4-12b-gguf

Text Generation • 12B • Updated Nov 25, 2024 • 2.11k • 41

anthracite-org/magnum-v4-12b

Text Generation • 12B • Updated Nov 25, 2024 • 625 • • 48

mradermacher/magnum-v4-12b-GGUF

12B • Updated Nov 26, 2024 • 9.71k • 5

mradermacher/magnum-v4-12b-i1-GGUF

12B • Updated Nov 26, 2024 • 405 • 8

Infermatic/magnum-v4-72b-FP8-Dynamic

Text Generation • 73B • Updated Oct 21, 2024 • 1.46k • • 6

Triangle104/magnum-v4-12b-Q8_0-GGUF

Text Generation • 12B • Updated Oct 24, 2024 • 131 • 2

zetasepic/Qwen2.5-72B-Instruct-abliterated-v2-GGUF

Text Generation • 73B • Updated Oct 28, 2024 • 1.39k • 4

Qwen/Qwen2.5-Coder-0.5B-Instruct

Text Generation • 0.5B • Updated Nov 18, 2024 • 1.82M • 65

Qwen/Qwen2.5-Coder-3B-Instruct

Text Generation • 3B • Updated Jan 12, 2025 • 143k • • 95

Qwen/Qwen2.5-Coder-14B-Instruct-GPTQ-Int8

Text Generation • 15B • Updated Jan 12, 2025 • 8.35k • 6

Qwen/Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation • 33B • Updated Jan 12, 2025 • 153k • 186

Qwen/Qwen2.5-Coder-14B-Instruct-AWQ

Text Generation • 15B • Updated Jan 12, 2025 • 159k • 16

Qwen/Qwen2.5-Coder-14B-Instruct-GGUF

Text Generation • 15B • Updated Nov 12, 2024 • 34.1k • 93

mlx-community/Qwen2.5-Coder-0.5B-Instruct-4bit

Text Generation • Updated Nov 11, 2024 • 205 • 6

lmstudio-community/Qwen2.5-32B-Instruct-MLX-4bit

Text Generation • 5B • Updated Nov 13, 2024 • 1.06k • 3

huihui-ai/Qwen2.5-Coder-14B-Instruct-abliterated

Text Generation • 15B • Updated Nov 25, 2024 • 5.81k • 8

bartowski/Qwen2.5-Coder-32B-Instruct-abliterated-GGUF

Text Generation • 33B • Updated Nov 14, 2024 • 5.38k • 38

bartowski/Qwen2.5-Coder-3B-Instruct-abliterated-GGUF

Text Generation • 3B • Updated Nov 14, 2024 • 9.63k • 15

MaziyarPanahi/calme-3.2-instruct-78b

Text Generation • 78B • Updated Jan 20, 2025 • 666 • 190

NousResearch/Hermes-3-Llama-3.2-3B

Text Generation • Updated Dec 18, 2024 • 207k • 175

NousResearch/Hermes-3-Llama-3.2-3B-GGUF

3B • Updated Dec 18, 2024 • 1.47k • 58

mradermacher/Qwen2.5-14B-Instruct-abliterated-v2-GGUF

15B • Updated Aug 1, 2025 • 10.1k • 7