SequentialLearning
/

SuperLinear

mixture-of-experts

Model card Files Files and versions

lirannoc commited on Jul 14

Commit

7a346d0

·

verified ·

1 Parent(s): 7c2d752

Update config.json

Files changed (1) hide show

config.json +0 -1

config.json CHANGED Viewed

@@ -13,7 +13,6 @@
   "train_pred_len": 96,
   "_comment_moe": "MoE (Mixture of Experts) parameters",
-  "n_experts": 4,
   "top_k_experts": 12,
   "noisy_gating_std": 0.1,
   "moe_temp": 1.0,

   "train_pred_len": 96,
   "_comment_moe": "MoE (Mixture of Experts) parameters",
   "top_k_experts": 12,
   "noisy_gating_std": 0.1,
   "moe_temp": 1.0,