Commit
·
3f784a8
1
Parent(s):
ae7c5d4
Updated readme
Browse files
README.md
CHANGED
|
@@ -3,42 +3,19 @@ title: MTEB Leaderboard
|
|
| 3 |
emoji: 🥇
|
| 4 |
colorFrom: blue
|
| 5 |
colorTo: indigo
|
| 6 |
-
sdk:
|
| 7 |
-
|
| 8 |
app_file: app.py
|
| 9 |
-
pinned:
|
| 10 |
tags:
|
| 11 |
- leaderboard
|
| 12 |
startup_duration_timeout: 1h
|
| 13 |
fullWidth: true
|
|
|
|
| 14 |
---
|
| 15 |
|
| 16 |
-
|
| 17 |
|
| 18 |
-
|
| 19 |
|
| 20 |
-
This repository contains legacy code for pushing and updating the MTEB leaderboard daily.
|
| 21 |
|
| 22 |
-
| Relevant Links | Decription |
|
| 23 |
-
|------------------------------------------|------------------------------|
|
| 24 |
-
| [mteb](https://github.com/embeddings-benchmark/mteb) | The implementation of the benchmark. Here you e.g. find the code to run your model on the benchmark. |
|
| 25 |
-
| [leaderboard](https://huggingface.co/spaces/mteb/leaderboard) | The leaderboard itself, here you can view results of model run on MTEB. |
|
| 26 |
-
| [results](https://github.com/embeddings-benchmark/results) | The results of MTEB is stored here. To learn how to add results to the Leaderboard, refer to the documentation: [Adding a Model to the Leaderboard](https://github.com/embeddings-benchmark/mteb/blob/main/docs/adding_a_model.md).
|
| 27 |
-
|
|
| 28 |
-
|
| 29 |
-
## Developer setup
|
| 30 |
-
|
| 31 |
-
To setup the repository:
|
| 32 |
-
|
| 33 |
-
```bash
|
| 34 |
-
git clone https://github.com/embeddings-benchmark/leaderboard.git
|
| 35 |
-
cd leaderboard
|
| 36 |
-
# install requirements
|
| 37 |
-
pip install -r requirements.txt
|
| 38 |
-
# fetch new results
|
| 39 |
-
# python refresh.py
|
| 40 |
-
# if you'd like to add results to previously cached models, you may have to remove these models in `EXTERNAL_MODEL_RESULTS.json`
|
| 41 |
-
# you can also directly delete `EXTERNAL_MODEL_RESULTS.json` and it will recreate it (but be much slower)
|
| 42 |
-
# run the leaderboard
|
| 43 |
-
python app.py
|
| 44 |
-
```
|
|
|
|
| 3 |
emoji: 🥇
|
| 4 |
colorFrom: blue
|
| 5 |
colorTo: indigo
|
| 6 |
+
sdk: docker
|
| 7 |
+
app_port: 7860
|
| 8 |
app_file: app.py
|
| 9 |
+
pinned: true
|
| 10 |
tags:
|
| 11 |
- leaderboard
|
| 12 |
startup_duration_timeout: 1h
|
| 13 |
fullWidth: true
|
| 14 |
+
license: mit
|
| 15 |
---
|
| 16 |
|
| 17 |
+
# MTEB Leaderboard
|
| 18 |
|
| 19 |
+
The new massively-multilingual text embedding-benchmark's leaderboard.
|
| 20 |
|
|
|
|
| 21 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|