exllamav3 quantizations of zai-org/GLM-4.5.

2.00 bpw h6 84.517 GiB
3.00 bpw h6 125.398 GiB
4.00 bpw h6 166.280 GiB
5.00 bpw h6 207.162 GiB
6.00 bpw h6 248.043 GiB
8.00 bpw h8 329.987 GiB

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for MikeRoz/GLM-4.5-exl3

Base model

zai-org/GLM-4.5
Quantized
(30)
this model