Hugging Face's logo

Spaces:
xzuyn
/
Token-Count-Comparison
Running

App Files Community
xzuyn commited on
Commit
37f3323
·
verified ·
1 Parent(s): 17e0fea

Update app.py

Browse files
Files changed (1) hide show
  1. app.py +1 -1
app.py CHANGED
@@ -40,7 +40,7 @@ def tokenize(input_text):
40
  "RWKV-v5/RWKV-v6": rwkv5_tokens,
41
  "DeepSeek-LLM/DeepSeek-V2": deepseek_tokens,
42
  "InternLM": internlm_tokens,
43
- "InternLM2": internlm_tokens
44
  }
45
 
46
  # Sort the results in descending order based on token length
 
40
  "RWKV-v5/RWKV-v6": rwkv5_tokens,
41
  "DeepSeek-LLM/DeepSeek-V2": deepseek_tokens,
42
  "InternLM": internlm_tokens,
43
+ "InternLM2": internlm2_tokens
44
  }
45
 
46
  # Sort the results in descending order based on token length