Spaces:
Runtime error
Runtime error
added information to markdown
Browse files
app.py
CHANGED
|
@@ -40,13 +40,17 @@ text = """# Welcome to the ShaderEval Suite.
|
|
| 40 |
|
| 41 |
## Results
|
| 42 |

|
|
|
|
| 43 |
|
| 44 |
-
## Todo (feel free to contribute in a Pull Request)
|
| 45 |
-
- [~] leaderboard
|
| 46 |
- [?] supporting batches to speed up inference
|
| 47 |
- [ ] CER metric (via a custom metric perhaps?)
|
| 48 |
- [x] removing the pad_token warning
|
| 49 |
- [ ] adding OpenVINO pipelines for inference, pending on OpenVINO release
|
|
|
|
|
|
|
|
|
|
| 50 |
"""
|
| 51 |
|
| 52 |
|
|
|
|
| 40 |
|
| 41 |
## Results
|
| 42 |

|
| 43 |
+
Additionally, you can report results to your models and it should show up on this [leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=Vipitis%2FShadertoys-fine)
|
| 44 |
|
| 45 |
+
## Todo (feel free to contribute in a [Pull Request](https://huggingface.co/spaces/Vipitis/ShaderEval/discussions?status=open&type=pull_request))
|
| 46 |
+
- [~] leaderboard (via autoevaluate and self reporting)
|
| 47 |
- [?] supporting batches to speed up inference
|
| 48 |
- [ ] CER metric (via a custom metric perhaps?)
|
| 49 |
- [x] removing the pad_token warning
|
| 50 |
- [ ] adding OpenVINO pipelines for inference, pending on OpenVINO release
|
| 51 |
+
- [ ] task1b for "better" featuring a improved testset as well as better metrics. Will allow more generation parameters
|
| 52 |
+
- [ ] semantic match by comparing the rendered frames (depending on WGPU implementation?)
|
| 53 |
+
- [ ] CLIP match to evaluate rendered images fitting to title/description
|
| 54 |
"""
|
| 55 |
|
| 56 |
|