Models

0xSero/GLM-4.7-REAP-50-W4A16

Text Generation • 2B • Updated 11 days ago • 2.1k • 55

baichuan-inc/Baichuan-M3-235B-GPTQ-INT4

Text Generation • 235B • Updated 3 days ago • 457 • 8

0xSero/GLM-4.7-REAP-40-W4A16

Text Generation • 2B • Updated 12 days ago • 2.55k • 6

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 539 • 594

TheBloke/llama2_70b_chat_uncensored-GPTQ

Text Generation • 69B • Updated Sep 27, 2023 • 263 • 58

TheBloke/Mixtral-8x7B-Instruct-v0.1-GPTQ

Text Generation • 47B • Updated Dec 14, 2023 • 477k • 141

Qwen/Qwen1.5-MoE-A2.7B-Chat-GPTQ-Int4

Text Generation • 14B • Updated Jun 9, 2024 • 921 • 50

RedHatAI/Meta-Llama-3-70B-Instruct-quantized.w8a16

Text Generation • 71B • Updated Jul 18, 2024 • 754 • 6

Qwen/Qwen2.5-7B-Instruct-GPTQ-Int8

Text Generation • 8B • Updated Oct 18, 2024 • 5.04k • 18

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int8

Text Generation • 33B • Updated Oct 9, 2024 • 1.28k • 14

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8

Text Generation • 73B • Updated Oct 9, 2024 • 21.8k • 28

Qwen/Qwen2.5-Coder-7B-Instruct-GPTQ-Int4

Text Generation • 8B • Updated Nov 18, 2024 • 973k • 10

Qwen/Qwen2.5-Coder-32B-Instruct-GPTQ-Int4

Text Generation • 33B • Updated Nov 18, 2024 • 8.25k • 24

Qwen/Qwen3-30B-A3B-GPTQ-Int4

Text Generation • 31B • Updated May 21, 2025 • 301k • 44

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Lite

Text Generation • 721B • Updated Aug 30, 2025 • 5 • 2

btbtyler09/Kimi-Dev-72B-GPTQ-8bit

Text Generation • 73B • Updated Jun 18, 2025 • 5 • 1

LGAI-EXAONE/EXAONE-4.0-1.2B-GPTQ-Int8

Text Generation • 1B • Updated Aug 1, 2025 • 84 • 9

btbtyler09/Qwen3-Coder-30B-A3B-Instruct-gptq-8bit

Text Generation • 9B • Updated Aug 2, 2025 • 33 • 2

btbtyler09/Qwen3-Coder-30B-A3B-Instruct-gptq-4bit

Text Generation • 31B • Updated Aug 2, 2025 • 1.8k • 1

tcclaviger/Qwen3-Coder-42B-A3B-Instruct-TOTAL-RECALL-MASTER-CODER-M-512k-ctx-W4A16

Text Generation • 6B • Updated Oct 31, 2025 • 14 • 2

avtc/GLM-4.6-REAP-268B-A32B-GPTQMODEL-W4A16

Text Generation • 271B • Updated 29 days ago • 166 • 3

Kirim-ai/Kirim-V1-Base

Text Generation • 12B • Updated Dec 13, 2025 • 15 • 3

btbtyler09/Devstral-Small-2-24B-Instruct-INT4-INT8-Mixed-GPTQ

Image-to-Text • 7B • Updated 23 days ago • 2k • 1

tencent/HY-MT1.5-1.8B-GPTQ-Int4

Translation • 2B • Updated 15 days ago • 1.12k • 11

SamMikaelson/deepseek-ocr-gptq-4bit

Updated 8 days ago • 272 • 1

xhxlb/IQuest-Coder-V1-40B-Instruct-int4

Text Generation • 6B • Updated 8 days ago • 2

elinas/alpaca-13b-lora-int4

Text Generation • Updated Apr 5, 2023 • 16 • 41

elinas/alpaca-30b-lora-int4

Text Generation • Updated Apr 5, 2023 • 16 • 68

mayaeary/pygmalion-6b-4bit-128g

Text Generation • Updated Mar 28, 2023 • 15 • 40

mayaeary/pygmalion-6b_dev-4bit-128g

Text Generation • Updated Mar 28, 2023 • 17 • 121