Update README.md
Browse files
README.md
CHANGED
|
@@ -191,6 +191,23 @@ Please refer to [togethercomputer/RedPajama-Data-1T](https://huggingface.co/data
|
|
| 191 |
|
| 192 |
Please refer to our [blog post](https://together.xyz) for benchmark results.
|
| 193 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 194 |
## Community
|
| 195 |
|
| 196 |
Join us on [Together Discord](https://discord.gg/6ZVDU8tTD4)
|
|
|
|
| 191 |
|
| 192 |
Please refer to our [blog post](https://together.xyz) for benchmark results.
|
| 193 |
|
| 194 |
+
## Intermediate Checkpoints
|
| 195 |
+
|
| 196 |
+
We provide 11 intermediate checkpoints that have been released for study.
|
| 197 |
+
The checkpoints are organized based on the number of tokens they contain, ranging from 240 billion tokens to 1 trillion tokens.
|
| 198 |
+
|
| 199 |
+
- [240b_tokens](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base/tree/240b_tokens)
|
| 200 |
+
- [280b_tokens](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base/tree/280b_tokens)
|
| 201 |
+
- [400b_tokens](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base/tree/400b_tokens)
|
| 202 |
+
- [440b_tokens](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base/tree/440b_tokens)
|
| 203 |
+
- [500b_tokens](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base/tree/500b_tokens)
|
| 204 |
+
- [600b_tokens](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base/tree/600b_tokens)
|
| 205 |
+
- [700b_tokens](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base/tree/700b_tokens)
|
| 206 |
+
- [720b_tokens](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base/tree/720b_tokens)
|
| 207 |
+
- [960b_tokens](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base/tree/960b_tokens)
|
| 208 |
+
- [1t_tokens](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base/tree/1t_tokens)
|
| 209 |
+
- [latest](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base/tree/main)
|
| 210 |
+
|
| 211 |
## Community
|
| 212 |
|
| 213 |
Join us on [Together Discord](https://discord.gg/6ZVDU8tTD4)
|