Qwen
/

Qwen1.5-MoE-A2.7B-Chat-GPTQ-Int4

Text Generation

4-bit precision

Model card Files Files and versions

hzhwcmhf commited on Jun 9, 2024

Commit

81b132a

·

verified ·

1 Parent(s): fa305d3

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -30,7 +30,7 @@
     "dataset": null,
     "desc_act": false,
     "exllama_config": {
-      "version": 1
     },
     "group_size": 128,
     "max_input_length": null,

     "dataset": null,
     "desc_act": false,
     "exllama_config": {
+      "version": 2
     },
     "group_size": 128,
     "max_input_length": null,