LoneStriker/tigerbot-70b-chat-v2-6.0bpw-h6-exl2

A cutting-edge foundation for your very own LLM.

💻Github • 🌐 TigerBot • 🤗 Hugging Face

快速开始

• 方法1，通过transformers使用

  • 下载 TigerBot Repo

    git clone https://github.com/TigerResearch/TigerBot.git
    

  • 启动infer代码

    python infer.py --model_path TigerResearch/tigerbot-70b-chat-v2
    

• 方法2:

  • 下载 TigerBot Repo

    git clone https://github.com/TigerResearch/TigerBot.git
    

  • 安装git lfs： git lfs install

  • 通过huggingface或modelscope平台下载权重

    git clone https://huggingface.co/TigerResearch/tigerbot-70b-chat-v2
    git clone https://www.modelscope.cn/TigerResearch/tigerbot-70b-chat-v2.git
    

  • 启动infer代码

    python infer.py --model_path tigerbot-70b-chat-v2
    

---

Quick Start

• Method 1, use through transformers

  • Clone TigerBot Repo

    git clone https://github.com/TigerResearch/TigerBot.git
    

  • Run infer script

    python infer.py --model_path TigerResearch/tigerbot-70b-chat-v2
    

• Method 2:

  • Clone TigerBot Repo

    git clone https://github.com/TigerResearch/TigerBot.git
    

  • install git lfs： git lfs install

  • Download weights from huggingface or modelscope

    git clone https://huggingface.co/TigerResearch/tigerbot-70b-chat-v2
    git clone https://www.modelscope.cn/TigerResearch/tigerbot-70b-chat-v2.git
    

  • Run infer script

    python infer.py --model_path tigerbot-70b-chat-v2