aisingapore
/

Qwen-SEA-LION-v4-32B-IT-8BIT

Text Generation

text-generation-inference

compressed-tensors

Model card Files Files and versions

Jian-Gang commited on 10 days ago

Commit

0612547

·

verified ·

1 Parent(s): ef4b8f9

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -156,7 +156,7 @@ For details on Qwen-SEA-LION-v4-32B-IT performance, please refer to the SEA-HELM
 - Model size taken from vLLM upon loading
 - Input size 4K, output 1K
 - Tests conducted on a system with an NVIDIA H200 GPU
-- For more details on the quantized model, please refer to [config.json](https://huggingface.co/aisingapore/Qwen-SEA-LION-v4-32B-IT/blob/main/config.json)
 ## More Information

 - Model size taken from vLLM upon loading
 - Input size 4K, output 1K
 - Tests conducted on a system with an NVIDIA H200 GPU
+- For more details on the quantized model, please refer to [config.json](https://huggingface.co/aisingapore/Qwen-SEA-LION-v4-32B-IT-8BIT/blob/main/config.json)
 ## More Information