made with https://github.com/Thireus/llama.cpp.git --branch tr-qwen3-vl-3-b6981-ab45b1a

Downloads last month
254
GGUF
Model size
31B params
Architecture
qwen3vlmoe
Hardware compatibility
Log In to view the estimation

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for Hugguf/Qwen3-VL-30B-A3B-Instruct-GGUF

Quantized
(18)
this model