Inference Providers
Active filters: 3-bit
MaziyarPanahi/Yi-Coder-9B-Chat-GGUF
Text Generation
• 9B • Updated • 111k
• 9
88B • Updated • 37.5k
• 13
unsloth/Qwen3.6-35B-A3B-UD-MLX-3bit
Image-Text-to-Text
• 5B • Updated • 13k
• 8
deucebucket/Gemma-4-E4B-it-Cerebellum-v2-GGUF
Image-Text-to-Text
• 8B • Updated • 758
• 3
deucebucket/Gemma-4-26B-A4B-it-Cerebellum-v6-GGUF
Image-Text-to-Text
• 25B • Updated • 3.32k
• 9
deucebucket/Qwen3.6-35B-A3B-Cerebellum-GGUF
Image-Text-to-Text
• 35B • Updated • 1.06k
• 8
MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF
Text Generation
• 141B • Updated • 114k
• 77
MaziyarPanahi/gemma-3-12b-it-GGUF
Text Generation
• 12B • Updated • 111k
• 19
MaziyarPanahi/Qwen3-8B-GGUF
Text Generation
• 8B • Updated • 239k
• 10
MoringLabs/Nemotron-3-Super-120B-A12B-MLX-3.6bit
Text Generation
• 121B • Updated • 765
• 4
RepublicOfKorokke/Qwen3-Coder-Next-REAP-48B-A3B-oQ3.5
Text Generation
• 7B • Updated • 681
• 2
manjunathshiva/gpt-oss-20b-tq3
Text Generation
• 22B • Updated • 3.64k
• 46
majentik/Qwen3.6-35B-A3B-RotorQuant-MLX-3bit
Image-Text-to-Text
• 35B • Updated • 1.46k
• 3
majentik/Qwen3.6-35B-A3B-TurboQuant-MLX-3bit
Image-Text-to-Text
• 35B • Updated • 2.51k
• 5
mlx-community/Qwen3.6-27B-AEON-Ultimate-Uncensored-BF16-mlx-3Bit
Text Generation
• 27B • Updated • 1.12k
• 1
deucebucket/Gemma-4-26B-A4B-it-Cerebellum-GGUF
Text Generation
• 25B • Updated • 735
• 4
deucebucket/Gemma-4-E2B-it-Cerebellum-v2-GGUF
Image-Text-to-Text
• 5B • Updated • 497
• 3
kaitchup/Llama-2-7b-gptq-3bit
Text Generation
• Updated • 5
clibrain/Llama-2-7b-ft-instruct-es-gptq-3bit
Text Generation
• Updated • 9
• 3
clibrain/Llama-2-13b-ft-instruct-es-gptq-3bit
Text Generation
• Updated • 13
• 3
MiNeves-tops/opt-125m-gptq-3bit
Text Generation
• Updated • 4
Text Generation
• Updated • 12
LoneStriker/Yi-6B-200K-3.0bpw-h6-exl2
Text Generation
• Updated • 9
danny0122/Llama-2-7b-hf-gptq-3bits
Text Generation
• 6B • Updated • 3
danny0122/Llama-2-7b-hf-gptq-3bitssafe
Text Generation
• 6B • Updated • 5
danny0122/stablelm-base-alpha-3b-gptq-3bits
Text Generation
• 3B • Updated • 3
danny0122/stablelm-base-alpha-3b-gptq-3bitssafe
Text Generation
• 3B • Updated • 6
SicariusSicariiStuff/Tenebra_PreAlpha_128g_3BIT
Text Generation
• 31B • Updated • 4
mahihossain666/llama-2-70b-hf-quantized-3bits-GPTQ
Text Generation
• 65B • Updated • 7
SicariusSicariiStuff/Tenebra_PreAlpha_No_Group_g_3BIT
Text Generation
• 31B • Updated • 4