tencent
/

Hunyuan-MT-7B

hunyuan_v1_dense

text-generation

Model card Files Files and versions

hhoh commited on Sep 2

Commit

a6b982d

·

verified ·

1 Parent(s): ea165c3

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -24,7 +24,7 @@
   "initializer_range": 0.02,
   "intermediate_size": 14336,
   "mask_init_id": 12,
-  "max_position_embeddings": 10240,
   "mlp_bias": false,
   "model_type": "hunyuan_v1_dense",
   "norm_type": "rms",

   "initializer_range": 0.02,
   "intermediate_size": 14336,
   "mask_init_id": 12,
+  "max_position_embeddings": 32768,
   "mlp_bias": false,
   "model_type": "hunyuan_v1_dense",
   "norm_type": "rms",