Spaces:
Running
Running
update submission instructions to reduce confusion
Browse files
utils.py
CHANGED
|
@@ -66,11 +66,13 @@ CITATION_BUTTON_TEXT = r"""@article{jiang2024vlm2vec,
|
|
| 66 |
}"""
|
| 67 |
|
| 68 |
SUBMIT_INTRODUCTION = """# Submit on MMEB Leaderboard Introduction \n
|
| 69 |
-
# <span style="color:#FFA500; font-weight:bold;"
|
| 70 |
1. **Step 1️⃣:** Please refer to the [**GitHub page**](https://github.com/TIGER-AI-Lab/VLM2Vec) for detailed instructions about evaluating your model. \n
|
| 71 |
2. **Step 2️⃣:** After running the evaluation pipelines, please use the script we provided \(e.g., [report_score_v2.py](https://github.com/TIGER-AI-Lab/VLM2Vec/blob/main/experiments/report_score_v2.py)\) to generate the unified score sheet.
|
| 72 |
-
-
|
| 73 |
-
|
|
|
|
|
|
|
| 74 |
```json
|
| 75 |
{
|
| 76 |
"metadata": {
|
|
|
|
| 66 |
}"""
|
| 67 |
|
| 68 |
SUBMIT_INTRODUCTION = """# Submit on MMEB Leaderboard Introduction \n
|
| 69 |
+
# <span style="color:#FFA500; font-weight:bold;">We have provided detailed step-by-step guides on how to submit your model. Please read carefully in order to submit successfully.</span> \n
|
| 70 |
1. **Step 1️⃣:** Please refer to the [**GitHub page**](https://github.com/TIGER-AI-Lab/VLM2Vec) for detailed instructions about evaluating your model. \n
|
| 71 |
2. **Step 2️⃣:** After running the evaluation pipelines, please use the script we provided \(e.g., [report_score_v2.py](https://github.com/TIGER-AI-Lab/VLM2Vec/blob/main/experiments/report_score_v2.py)\) to generate the unified score sheet.
|
| 72 |
+
- Reminder: Don't forget to adjust your model's configurations in the script, including model name, URL, model size, and data source.
|
| 73 |
+
- Note that the "model size" field is by default in Billions (B), and only digits are allowed, so please convert it accordingly if your model size is in different units (e.x., "8" for 8 billion, "0.5" for 500 million, don't include non-digits in it).
|
| 74 |
+
- Note: Please double check that your score sheet should look like the following format ⬇️: \n
|
| 75 |
+
- (⚠️ There are remaining steps to be continued after this code block) \n
|
| 76 |
```json
|
| 77 |
{
|
| 78 |
"metadata": {
|