Spaces:

---

open-llm-leaderboard

/

open_llm_leaderboard

like 13.6k

Running on CPU Upgrade

yeah my merge too I tried 2 times but it failed no idea why 🤔.

https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/Aryanne/QwentileSwap_eval_request_False_bfloat16_Original.json

Submitted once and failed.

https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/FuseAI/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_eval_request_False_bfloat16_Original.json

Mine failed too https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/tomasmcm/sky-t1-coder-32b-flash_eval_request_False_bfloat16_Original.json
Is it because we are missing the base_model?

mine failed too

Hi @ehristoforu ,

Your model ehristoforu/testq-32b has finished the evaluation!

For other mentioned models, I'll check them separately, please expect to get the results for the end of the week