Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

77

Base only

Active filters: vulkan

vmarcelo/Qwen3.8-27B-MIX_GGUF

Text Generation • 27B • Updated 2 days ago • 4.55k • 8

julianmb/Qwen-3.8-27B-ROCmFP4-FAST-GGUF

Text Generation • 27B • Updated about 1 hour ago • 7.92k • 8

plunderstruck/Qwen3.6-35B-A3B-MTP-ROCmFP4-GGUF

0.4B • Updated Jun 21 • 1.48k • 14

julianmb/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-ROCmFP4-GGUF

Text Generation • 32B • Updated 7 days ago • 483 • 2

clxudfast/huihui4-8b-a4b-v2-Q4_K_M

8B • Updated Apr 27 • 34 • 1

plunderstruck/Qwen3.6-27B-MTP-ROCmFP4-GGUF

0.5B • Updated Jun 21 • 1.12k • 32

plunderstruck/Qwopus3.6-27B-Coder-MTP-ROCmFP4-GGUF

0.5B • Updated Jun 21 • 399 • 8

plunderstruck/Qwen3.6-40B-Deckard-MTP-ROCmFP4-GGUF

0.5B • Updated Jun 21 • 4.36k • 9

plunderstruck/Qwen3.6-27B-OBLITERATED-MTP-ROCmFP4-GGUF

0.5B • Updated Jun 21 • 942 • 5

petr567/Ornith-1.0-35B-MTP-Strix-Halo-Hybrid-GGUF

Text Generation • 36B • Updated about 1 month ago • 1.08k • 8

vmlinux/Qwen3.6-27B-Architect-Polaris2-Fable-B-F451-MTP-ROCmFPX-GGUF

Text Generation • 27B • Updated 9 days ago • 245 • 4

cygnal/Qwen3.8-27B-heretic-ara-Q4_K_M-MTP-GGUF

0.5B • Updated about 1 hour ago • 2.5k • 1

pugant/Qwen3.8-27B-MTP-Q4_0_ROCMFP4_STRIX_LEAN

Text Generation • 27B • Updated 3 days ago • 156 • 1

finex666/Qwen3.8-27B-Abliterated-IQ4-MIX-MTP-GGUF

Text Generation • 27B • Updated 3 days ago • 931 • 1

raining-codes/Gemma3-1B-LOMO-q4f16_1-MLC

Text Generation • Updated Oct 19, 2025

raining-codes/Gemma3-270M-LOMO-q4f16_1-MLC

Text Generation • Updated Oct 19, 2025

raining-codes/Qwen3-0.6B-LOMO-q4f16_1-MLC

Text Generation • Updated Oct 19, 2025 • 3

raining-codes/Qwen3-1.7B-LOMO-q4f16_1-MLC

Text Generation • Updated Oct 20, 2025 • 1

raining-codes/Qwen3-1.7B-LOMO-q4f16_1-MLC2

Text Generation • Updated Oct 21, 2025

ABBNDZ/ATTS1HG1

Text-to-Speech • 0.4B • Updated Mar 17 • 146 • 1

0xSero/Qwen3.6-35B-GGUF

Text Generation • 35B • Updated May 30 • 2.18k • 25

MarkShark2/omnivoice-onnx-kv-b1-fp16

Text-to-Speech • Updated Apr 27 • 1

MarkShark2/flux2-klein-4b-onnx-webgpu-q4

Text-to-Image • Updated May 1

eric717273/Qwen3.5-122B-A10B-MXFP4_MOE-MTP-GGUF

Text Generation • 125B • Updated May 13 • 205 • 1

mlc911/drunet-ncnn

Image-to-Image • Updated May 19

jcbtc/qwen3.6-35b-a3b-crown-halo-mtp-dynamic

Image-Text-to-Text • 36B • Updated Jun 19 • 1.37k • 18

cafonez/GLM-4.7-Flash-REAP-23B-A3B-ROCmFP4-GGUF

23B • Updated Jun 7 • 48

zakarth/talkie-1930-13b-it-vulkan-fixed-GGUF

13B • Updated Jun 9 • 319 • 3

plunderstruck/Qwen3-Coder-Next-ROCmFP4-GGUF

80B • Updated Jun 21 • 308 • 3

plunderstruck/Nex-N2-mini-ROCmFP4-GGUF

35B • Updated Jun 21 • 104 • 6