-
-
-
-
-
-
Inference Providers
Active filters:
gptq
MidnightPhreaker/GLM-4.5-Air-REAP-82B-A12B-GPTQ-INT4-gs32
14B
•
Updated
•
200
•
3
TheBloke/MythoMax-L2-13B-GPTQ
Text Generation
•
2B
•
Updated
•
750
•
215
Qwen/Qwen3-235B-A22B-GPTQ-Int4
Text Generation
•
Updated
•
62.5k
•
25
QuantTrio/Qwen3-30B-A3B-Instruct-2507-GPTQ-Int8
Text Generation
•
8B
•
Updated
•
188k
•
9
TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ
Text Generation
•
2B
•
Updated
•
330
•
320
TheBloke/Phind-CodeLlama-34B-v2-GPTQ
Text Generation
•
5B
•
Updated
•
20
•
90
TheBloke/Psyfighter-13B-GPTQ
Text Generation
•
2B
•
Updated
•
10
•
7
Qwen/Qwen2-VL-2B-Instruct-GPTQ-Int4
Image-Text-to-Text
•
1B
•
Updated
•
921
•
27
Qwen/Qwen2.5-14B-Instruct-GPTQ-Int4
Text Generation
•
3B
•
Updated
•
21.5k
•
24
Qwen/Qwen2.5-Coder-32B-Instruct-GPTQ-Int4
Text Generation
•
6B
•
Updated
•
33.5k
•
21
Satwik11/Microsoft-phi-4-Instruct-AutoRound-GPTQ-4bit
3B
•
Updated
•
3
•
2
Qwen/Qwen3-30B-A3B-GPTQ-Int4
Text Generation
•
5B
•
Updated
•
86.4k
•
36
xiangxinai/Xiangxin-Guardrails-Text
Text Generation
•
3B
•
Updated
•
111
•
10
QuantTrio/Kimi-Dev-72B-GPTQ-Int4
Text Generation
•
73B
•
Updated
•
46
•
1
QuantTrio/Kimi-Dev-72B-GPTQ-Int8
Text Generation
•
73B
•
Updated
•
15
•
1
ModelCloud/GLM-4.6-GPTQMODEL-W4A16-v2
Text Generation
•
357B
•
Updated
•
137
•
1
ModelCloud/GLM-4.6-REAP-268B-A32B-GPTQMODEL-W4A16
Text Generation
•
269B
•
Updated
•
27
•
1
elinas/alpaca-13b-lora-int4
Text Generation
•
Updated
•
2
•
41
elinas/alpaca-30b-lora-int4
Text Generation
•
Updated
•
2
•
68
mayaeary/pygmalion-6b-4bit-128g
Text Generation
•
Updated
•
19
•
40
mayaeary/pygmalion-6b_dev-4bit-128g
Text Generation
•
Updated
•
8
•
120
mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g
Text Generation
•
Updated
•
1
•
2
mayaeary/PPO_Pygway-6b-Mix-4bit-128g
Text Generation
•
Updated
•
1
•
2
elinas/vicuna-13b-4bit
Text Generation
•
Updated
•
6
•
45
TheBloke/koala-7B-GPTQ
Text Generation
•
1B
•
Updated
•
14
•
31
TheBloke/koala-7B-HF
Text Generation
•
Updated
•
931
•
21
TheBloke/koala-13B-HF
Text Generation
•
Updated
•
511
•
41
TheBloke/koala-13B-GPTQ
Text Generation
•
2B
•
Updated
•
6
•
38
TheBloke/galpaca-30B-GPTQ
Text Generation
•
Updated
•
5
•
48
Ancestral/Dolly_Shygmalion-6b-4bit-128g
Text Generation
•
Updated
•
1
•
5