MINGYISU commited on
Commit
4e303da
·
1 Parent(s): 9ab81b0

update submission instructions to reduce confusion

Browse files
Files changed (1) hide show
  1. utils.py +5 -3
utils.py CHANGED
@@ -66,11 +66,13 @@ CITATION_BUTTON_TEXT = r"""@article{jiang2024vlm2vec,
66
  }"""
67
 
68
  SUBMIT_INTRODUCTION = """# Submit on MMEB Leaderboard Introduction \n
69
- # <span style="color:#FFA500; font-weight:bold;">!!!IMPORTANT: Please follow the steps below to submit your model.</span> \n
70
  1. **Step 1️⃣:** Please refer to the [**GitHub page**](https://github.com/TIGER-AI-Lab/VLM2Vec) for detailed instructions about evaluating your model. \n
71
  2. **Step 2️⃣:** After running the evaluation pipelines, please use the script we provided \(e.g., [report_score_v2.py](https://github.com/TIGER-AI-Lab/VLM2Vec/blob/main/experiments/report_score_v2.py)\) to generate the unified score sheet.
72
- - Note: Please double check that your score sheet should look like the following format: \n
73
- - (⚠️ Remaining steps to be continued after this code block) \n
 
 
74
  ```json
75
  {
76
  "metadata": {
 
66
  }"""
67
 
68
  SUBMIT_INTRODUCTION = """# Submit on MMEB Leaderboard Introduction \n
69
+ # <span style="color:#FFA500; font-weight:bold;">We have provided detailed step-by-step guides on how to submit your model. Please read carefully in order to submit successfully.</span> \n
70
  1. **Step 1️⃣:** Please refer to the [**GitHub page**](https://github.com/TIGER-AI-Lab/VLM2Vec) for detailed instructions about evaluating your model. \n
71
  2. **Step 2️⃣:** After running the evaluation pipelines, please use the script we provided \(e.g., [report_score_v2.py](https://github.com/TIGER-AI-Lab/VLM2Vec/blob/main/experiments/report_score_v2.py)\) to generate the unified score sheet.
72
+ - Reminder: Don't forget to adjust your model's configurations in the script, including model name, URL, model size, and data source.
73
+ - Note that the "model size" field is by default in Billions (B), and only digits are allowed, so please convert it accordingly if your model size is in different units (e.x., "8" for 8 billion, "0.5" for 500 million, don't include non-digits in it).
74
+ - Note: Please double check that your score sheet should look like the following format ⬇️: \n
75
+ - (⚠️ There are remaining steps to be continued after this code block) \n
76
  ```json
77
  {
78
  "metadata": {