Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,212

Base only

Active filters: vllm

mistralai/Mixtral-8x22B-v0.1

141B • Updated Jul 24, 2025 • 4.96k • 238

mistralai/Mistral-7B-v0.3

7B • Updated Jul 24, 2025 • 318k • 579

RedHatAI/DeepSeek-Coder-V2-Lite-Instruct-FP8

Text Generation • 16B • Updated Jul 18, 2024 • 156k • 13

mistralai/Ministral-8B-Instruct-2410

8B • Updated Jul 31, 2025 • 267k • 580

mistralai/Mistral-Large-Instruct-2411

123B • Updated Jul 28, 2025 • 11.7k • 260

mradermacher/Mistral-Small-24B-Instruct-2501-i1-GGUF

24B • Updated Jul 25, 2025 • 549 • 6

NousResearch/DeepHermes-3-Llama-3-8B-Preview

Text Generation • 8B • Updated Apr 10, 2025 • 1.57k • • 362

mistralai/Voxtral-Mini-3B-2507

5B • Updated Jul 28, 2025 • 458k • 653

mistralai/Voxtral-Small-24B-2507

Audio-Text-to-Text • 24B • Updated Dec 20, 2025 • 46.7k • 496

unsloth/gpt-oss-20b

Text Generation • 22B • Updated Aug 9, 2025 • 13.4k • 47

ByteDance-Seed/Seed-OSS-36B-Instruct

Text Generation • 36B • Updated Aug 26, 2025 • 37.7k • 499

RedHatAI/gpt-oss-120b

Text Generation • 120B • Updated 12 days ago • 945 • 5

RedHatAI/gpt-oss-20b

Text Generation • 22B • Updated Apr 28 • 31.7k • 6

unsloth/Magistral-Small-2509-GGUF

24B • Updated Sep 17, 2025 • 11.7k • 100

openai/gpt-oss-safeguard-120b

Text Generation • 120B • Updated Oct 29, 2025 • 41.1k • 97

mistralai/Ministral-3-8B-Instruct-2512-BF16

9B • Updated Jan 15 • 51.4k • 21

mistralai/Ministral-3-14B-Instruct-2512-BF16

14B • Updated Jan 15 • 15.3k • 22

mistralai/Ministral-3-8B-Instruct-2512

9B • Updated Jan 15 • 187k • 172

mistralai/Ministral-3-3B-Reasoning-2512-GGUF

3B • Updated Jan 15 • 3.21k • 37

mistralai/Devstral-2-123B-Instruct-2512

125B • Updated Feb 25 • 10.2k • 322

unsloth/Ministral-3-14B-Reasoning-2512-GGUF

14B • Updated Dec 4, 2025 • 13.9k • 47

unsloth/Ministral-3-14B-Reasoning-2512-unsloth-bnb-4bit

14B • Updated Dec 6, 2025 • 361 • 2

unsloth/Ministral-3-3B-Reasoning-2512-GGUF

3B • Updated Dec 4, 2025 • 8.21k • 18

unsloth/Ministral-3-14B-Instruct-2512-GGUF

14B • Updated Dec 4, 2025 • 14.1k • 82

unsloth/Ministral-3-8B-Instruct-2512-GGUF

8B • Updated Dec 4, 2025 • 12.6k • 34

mlx-community/Ministral-3-3B-Instruct-2512-4bit

Updated Dec 3, 2025 • 21.9k • 5

unsloth/Devstral-2-123B-Instruct-2512-GGUF

125B • Updated Dec 15, 2025 • 3.17k • 55

GadflyII/GLM-4.6V-NVFP4

Image-Text-to-Text • 62B • Updated Jan 12 • 702 • 11

bakrianoo/arabic-legal-documents-ocr-1.0

Image-Text-to-Text • 4B • Updated Feb 4 • 538 • • 39

bullpoint/Qwen3-Coder-Next-AWQ-4bit

Text Generation • 14B • Updated Feb 3 • 45.2k • 26