Models

MaziyarPanahi/Mixtral-8x22B-Instruct-v0.1-AWQ

Text Generation • 141B • Updated Apr 18, 2024 • 8.48k • 12

QuantTrio/GLM-4.7-Flash-AWQ

Text Generation • 31B • Updated 12 days ago • 53.5k • 3

QuantTrio/Step3-VL-10B-AWQ

Image-Text-to-Text • 10B • Updated about 12 hours ago • 4.23k • 5

solidrust/Mistral-7B-Instruct-v0.3-AWQ

Text Generation • 7B • Updated Sep 3, 2024 • 331k • 7

solidrust/dolphin-2.9.4-llama3.1-8b-AWQ

Text Generation • 8B • Updated Sep 3, 2024 • 255 • 4

QuantTrio/Qwen3-235B-A22B-Thinking-2507-AWQ

Text Generation • 235B • Updated Sep 5, 2025 • 3.66k • 6

QuantTrio/Qwen3-Coder-30B-A3B-Instruct-AWQ

Text Generation • 31B • Updated Sep 5, 2025 • 10.2k • 6

QuantTrio/Qwen3-VL-235B-A22B-Instruct-AWQ

Text Generation • 236B • Updated Oct 8, 2025 • 4.87k • 12

QuantTrio/Qwen3-VL-32B-Thinking-AWQ

Image-Text-to-Text • 33B • Updated Dec 3, 2025 • 1.65k • 4

QuantTrio/DeepSeek-V3.2-AWQ

Text Generation • 685B • Updated Dec 3, 2025 • 15k • 10

abhinavkulkarni/mosaicml-mpt-7b-instruct-w4-g128-awq

Text Generation • Updated Sep 12, 2023 • 5

abhinavkulkarni/mosaicml-mpt-7b-chat-w4-g128-awq

Text Generation • 1B • Updated Feb 21, 2024 • 16

abhinavkulkarni/VMware-open-llama-7b-open-instruct-w4-g128-awq

Text Generation • Updated Sep 12, 2023 • 11

abhinavkulkarni/VMware-open-llama-13b-open-instruct-w4-g128-awq

Text Generation • Updated Sep 12, 2023 • 6 • 3

abhinavkulkarni/tiiuae-falcon-7b-instruct-w4-g64-awq

Text Generation • Updated Sep 12, 2023 • 2 • 5

abhinavkulkarni/psmathur-orca_mini_v2_7b-w4-g128-awq

Text Generation • Updated Sep 12, 2023 • 5 • 2

abhinavkulkarni/Salesforce-codegen25-7b-multi-w4-g128-awq

Text Generation • Updated Sep 12, 2023 • 4 • 2

abhinavkulkarni/psmathur-orca_mini_v2_13b-w4-g128-awq

Text Generation • Updated Sep 12, 2023 • 3 • 2

abhinavkulkarni/mosaicml-mpt-30b-instruct-w4-g128-awq

Text Generation • Updated Sep 12, 2023 • 1 • 2

abhinavkulkarni/mosaicml-mpt-30b-chat-w4-g128-awq

Text Generation • 4B • Updated Jun 3, 2024 • 4

abhinavkulkarni/VMware-open-llama-7b-v2-open-instruct-w4-g128-awq

Text Generation • Updated Sep 12, 2023 • 2

abhinavkulkarni/tiiuae-falcon-40b-instruct-w4-g128-awq

Text Generation • Updated Sep 12, 2023 • 7 • 2

abhinavkulkarni/Salesforce-codegen25-7b-instruct-w4-g128-awq

Text Generation • Updated Sep 12, 2023 • 1 • 3

abhinavkulkarni/meta-llama-Llama-2-7b-chat-hf-w4-g128-awq

Text Generation • Updated Sep 12, 2023 • 3 • 6

abhinavkulkarni/meta-llama-Llama-2-13b-chat-hf-w4-g128-awq

Text Generation • Updated Sep 12, 2023 • 6 • 1

abhinavkulkarni/stabilityai-StableBeluga-7B-w4-g128-awq

Text Generation • Updated Sep 12, 2023 • 1 • 1

abhinavkulkarni/stabilityai-StableBeluga-13B-w4-g128-awq

Text Generation • Updated Sep 12, 2023 • 1 • 1

abhinavkulkarni/codellama-CodeLlama-7b-Instruct-hf-w4-g128-awq

Text Generation • Updated Sep 12, 2023

abhinavkulkarni/codellama-CodeLlama-7b-Python-hf-w4-g128-awq

Text Generation • Updated Sep 12, 2023 • 10

abhinavkulkarni/codellama-CodeLlama-13b-Instruct-hf-w4-g128-awq

Text Generation • 2B • Updated Sep 17, 2023 • 4