Update README.md
Browse files
README.md
CHANGED
|
@@ -31,8 +31,8 @@ With these datasets, we achieve the following scores on the JGLUE benchmark:
|
|
| 31 |
| jnli-1.1-0.3 | 0.504 | 0.48 |
|
| 32 |
| marc_ja-1.1-0.3 | 0.936 | 0.959 |
|
| 33 |
|
| 34 |
-
We achieved these scores by using the [lm-evaluation-harness](https://github.com/Stability-AI/lm-evaluation-harness) from Stability AI.
|
| 35 |
|
|
|
|
| 36 |
```bash
|
| 37 |
MODEL_ARGS=pretrained=lightblue/openorca_stx,use_accelerate=True
|
| 38 |
TASK="jsquad-1.1-0.3,jcommonsenseqa-1.1-0.3,jnli-1.1-0.3,marc_ja-1.1-0.3"
|
|
|
|
| 31 |
| jnli-1.1-0.3 | 0.504 | 0.48 |
|
| 32 |
| marc_ja-1.1-0.3 | 0.936 | 0.959 |
|
| 33 |
|
|
|
|
| 34 |
|
| 35 |
+
We achieved these scores by using the [lm-evaluation-harness](https://github.com/Stability-AI/lm-evaluation-harness) from Stability AI using the below commands:
|
| 36 |
```bash
|
| 37 |
MODEL_ARGS=pretrained=lightblue/openorca_stx,use_accelerate=True
|
| 38 |
TASK="jsquad-1.1-0.3,jcommonsenseqa-1.1-0.3,jnli-1.1-0.3,marc_ja-1.1-0.3"
|