Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,392

Base only

Active filters: autoround

albucino/Qwen3.8-Flash-Next-W4A16-FP8PLE

Text Generation • 73B • Updated about 21 hours ago • 1.97k • 30

Archsloth/Qwen3-4B-GGUF

Text Generation • 4B • Updated 5 days ago • 887 • 35

zerodigest/Qwen3.8-27B-Uncensored-YMQ-MTP-GGUF

Text Generation • 27B • Updated 16 days ago • 137k • 104

Archsloth/Qwen3.5-9B-GGUF

Image-Text-to-Text • 9B • Updated 5 days ago • 430 • 33

Archsloth/Qwen3.8-27B-GGUF

Image-Text-to-Text • 27B • Updated 5 days ago • 374 • 32

zerodigest/Qwen3.8-27B-YMQ-MTP-GGUF

Text Generation • 27B • Updated 16 days ago • 13.4k • 24

todiadiyatmo/Qwen3.8-Flash-Next-W4A16-Attn8-FP8PLE

Text Generation • 71B • Updated 6 days ago • 227 • 4

ultimaterex/Swift-Qwen3.8-27B-Uncensored-W4A16-AutoRound

Image-Text-to-Text • 29B • Updated about 8 hours ago • 3

Minachist/Qwen3.8-27B-INT8-AutoRound

Image-Text-to-Text • 9B • Updated 30 days ago • 3.98k • 13

zerodigest/Ornith-1.5-35B-Uncensored-YMQ-MTP-GGUF

Text Generation • 36B • Updated 15 days ago • 29.6k • 6

azampatti/Qwen3.8-Flash-Next-125B-A5B-INT4-AutoRound

Text Generation • 124B • Updated about 2 hours ago • 612 • 2

Chunity/gemma-4-E4B-it-AWQ-4bit

Image-Text-to-Text • 5B • Updated Apr 24 • 72.3k • 5

88plug/Qwen3.6-35B-A3B-W8A16

Image-Text-to-Text • 35B • Updated 15 days ago • 448 • 4

kaitchup/Muse-Glimmer-30B-autoscheme-3.5bit-XS

6B • Updated Aug 11 • 51 • 1

Frozenlock/Qwen3.8-27B-int4-AutoRound

Image-Text-to-Text • 6B • Updated Aug 16 • 43.2k • 20

Twu31/Qwen3.8-27B-AWQ-INT4-MTP-LowLatency

Image-Text-to-Text • 6B • Updated about 1 month ago • 5.91k • 5

noon-at-cgn/Qwen3.8-27B-Uncensored-W4A16-AutoRound

Image-Text-to-Text • 6B • Updated 15 days ago • 27.9k • 4

Pilcothink/Qwen3.8-27B-MixedInt2-ultra-lite

Image-Text-to-Text • 3B • Updated 26 days ago • 152 • 1

CySpiegel/Qwen3.8-27B-Int4-AutoRound

6B • Updated 23 days ago • 340 • 2

halt95/Qwen3.8-Flash-Next-W4A16-Merlin

Text Generation • 124B • Updated about 16 hours ago • 536 • 2

IndrasMirror/Swift-Qwen3.8-27B-Uncensored-W4A16

Image-Text-to-Text • 6B • Updated about 20 hours ago • 1

INCModel3/Qwen3.5-35B-A3B-MXFP8-CT-RTN-AutoRound

Text Generation • 36B • Updated 4 days ago • 68 • 3

fbaldassarri/meta-llama_Llama-3.2-1B-Instruct-auto_round-int4-gs128-asym

Text Generation • 0.4B • Updated Nov 11, 2024 • 15

fbaldassarri/meta-llama_Llama-3.2-1B-Instruct-auto_round-int4-gs128-sym

Text Generation • 0.4B • Updated Nov 11, 2024 • 25

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_round-int4-gs128-asym

Text Generation • 0.8B • Updated Nov 11, 2024 • 11

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_round-int4-gs128-sym

Text Generation • 0.8B • Updated Nov 11, 2024 • 13

fbaldassarri/meta-llama_Llama-3.2-11B-Vision-Instruct-OpenVino

Text Generation • Updated Nov 11, 2024 • 23 • 1

fbaldassarri/meta-llama_Llama-3.1-8B-Instruct-auto_round-int4-gs128-asym

Text Generation • 2B • Updated Nov 11, 2024 • 41

fbaldassarri/meta-llama_Llama-3.1-8B-Instruct-auto_round-int4-gs128-sym

Text Generation • 2B • Updated Nov 11, 2024 • 38

fbaldassarri/HuggingFaceTB_SmolLM2-1.7B-Instruct-auto_round-int4-gs128-sym

Text Generation • 0.3B • Updated Jan 4, 2025 • 18