Spaces:
Running
on
Zero
Running
on
Zero
Commit
·
c9c2b46
1
Parent(s):
934dfcd
Auto Daily Leaderboard udpate Tue Dec 3 12:00:28 PM EST 2024
Browse files- arena_elo/results/20241203/clean_battle_t2i_generation.json +0 -0
- arena_elo/results/20241203/clean_battle_video_generation.json +0 -0
- arena_elo/results/20241203/elo_results_t2i_generation.pkl +3 -0
- arena_elo/results/20241203/elo_results_video_generation.pkl +3 -0
- arena_elo/results/20241203/t2i_generation_leaderboard.csv +18 -0
- arena_elo/results/20241203/video_generation_leaderboard.csv +14 -0
- arena_elo/results/latest/clean_battle_t2i_generation.json +84 -0
- arena_elo/results/latest/clean_battle_video_generation.json +70 -0
- arena_elo/results/latest/elo_results_t2i_generation.pkl +2 -2
- arena_elo/results/latest/elo_results_video_generation.pkl +1 -1
- arena_elo/results/latest/t2i_generation_leaderboard.csv +17 -17
- arena_elo/results/latest/video_generation_leaderboard.csv +13 -13
arena_elo/results/20241203/clean_battle_t2i_generation.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
arena_elo/results/20241203/clean_battle_video_generation.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
arena_elo/results/20241203/elo_results_t2i_generation.pkl
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f5f79d98bb3a09431dd74dc406320e7245304dd008ff2ab2a63658a3b3ed860e
|
| 3 |
+
size 88250
|
arena_elo/results/20241203/elo_results_video_generation.pkl
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2d08dd5edb096da37bbac4877e9092341349851b711ee9d6b2136fa30e2e2750
|
| 3 |
+
size 75108
|
arena_elo/results/20241203/t2i_generation_leaderboard.csv
ADDED
|
@@ -0,0 +1,18 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
| 2 |
+
PlayGround V2.5,PlayGround V2.5,1121.0280133870144,1120.7165643560843,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
|
| 3 |
+
FLUX.1-dev,FLUX.1-dev,1119.76898699982,1139.6958331226583,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
|
| 4 |
+
FLUX.1-schnell,FLUX.1-schnell,1084.4060775713206,1075.2377635535684,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
|
| 5 |
+
PlayGround V2,PlayGround V2,1073.166017371307,1071.6479361169622,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
|
| 6 |
+
Kolors,Kolors,1052.716930806343,1051.3686171448594,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
|
| 7 |
+
StableCascade,StableCascade,1040.772440746402,1042.5792731490517,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
|
| 8 |
+
HunyuanDiT,HunyuanDiT,1027.904562748024,1020.7701445774316,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
|
| 9 |
+
PixArtAlpha,PixArtAlpha,1019.8078652983697,1010.8656349081784,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
|
| 10 |
+
SDXL-Lightning,SDXL-Lightning,1019.4615300489322,1022.0258326668156,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
|
| 11 |
+
PixArtSigma,PixArtSigma,1018.0544278583469,1017.3857308872836,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
|
| 12 |
+
SD3,SD3,1006.0486374544896,1008.966771056853,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
|
| 13 |
+
AuraFlow,AuraFlow,1004.2215162640015,999.0581930328785,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
|
| 14 |
+
SDXL,SDXL,967.104416616448,966.8787344387692,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
|
| 15 |
+
SDXLTurbo,SDXLTurbo,915.7461645573251,912.8653839131264,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
|
| 16 |
+
LCM(v1.5/XL),LCM(v1.5/XL),905.8707857250673,899.2438562320352,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
|
| 17 |
+
OpenJourney,OpenJourney,832.7813140066881,826.9804611621538,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
|
| 18 |
+
LCM,LCM,791.1403125400976,804.6812350769155,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
|
arena_elo/results/20241203/video_generation_leaderboard.csv
ADDED
|
@@ -0,0 +1,14 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
| 2 |
+
CogVideoX-5B,CogVideoX-5B,1160.9798558528043,1155.2825017564596,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
|
| 3 |
+
Pyramid Flow,Pyramid Flow,1144.4443150788584,1147.2395781116793,MIT LICENSE,Peking University,https://pyramid-flow.github.io/
|
| 4 |
+
StableVideoDiffusion,StableVideoDiffusion,1123.5142921556,1125.9492939358383,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
|
| 5 |
+
CogVideoX-2B,CogVideoX-2B,1059.4199799072226,1055.7878886216029,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
|
| 6 |
+
T2V-Turbo,T2V-Turbo,1055.141819717971,1054.473560987793,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
|
| 7 |
+
AnimateDiff,AnimateDiff,1043.18176646356,1041.909276574398,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
|
| 8 |
+
VideoCrafter2,VideoCrafter2,1039.650649385956,1040.368902202116,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
|
| 9 |
+
Allegro,Allegro,1001.1069655520251,1003.8077700559775,Apache 2.0,rhymes-ai,https://github.com/rhymes-ai/Allegro
|
| 10 |
+
LaVie,LaVie,969.0713041833375,969.634777080319,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
|
| 11 |
+
OpenSora,OpenSora,885.2459765161428,885.6299788044697,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
|
| 12 |
+
OpenSora v1.2,OpenSora v1.2,847.2049389414091,846.1074362119856,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
|
| 13 |
+
AnimateDiff Turbo,AnimateDiff Turbo,835.9335206139747,836.747355723456,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
|
| 14 |
+
ModelScope,ModelScope,835.1046156311368,837.0616799339045,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
|
arena_elo/results/latest/clean_battle_t2i_generation.json
CHANGED
|
@@ -108494,5 +108494,89 @@
|
|
| 108494 |
"judge": "arena_user_10.16.12.226",
|
| 108495 |
"anony": true,
|
| 108496 |
"tstamp": 1733145408.5838
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 108497 |
}
|
| 108498 |
]
|
|
|
|
| 108494 |
"judge": "arena_user_10.16.12.226",
|
| 108495 |
"anony": true,
|
| 108496 |
"tstamp": 1733145408.5838
|
| 108497 |
+
},
|
| 108498 |
+
{
|
| 108499 |
+
"model_a_conv_id": "0062a878fcde4e73946cef9f6dc71734",
|
| 108500 |
+
"model_b_conv_id": "2d956492bb434e6ebbc4d13834a6bf80",
|
| 108501 |
+
"inputs": {
|
| 108502 |
+
"prompt": "a man riding a snowmobile in the streets of boston residential area during winter at noon."
|
| 108503 |
+
},
|
| 108504 |
+
"model_a": "FLUX.1-dev",
|
| 108505 |
+
"model_b": "FLUX.1-schnell",
|
| 108506 |
+
"vote_type": "leftvote",
|
| 108507 |
+
"winner": "model_a",
|
| 108508 |
+
"judge": "arena_user_10.16.13.73",
|
| 108509 |
+
"anony": true,
|
| 108510 |
+
"tstamp": 1733174236.3784
|
| 108511 |
+
},
|
| 108512 |
+
{
|
| 108513 |
+
"model_a_conv_id": "bf589d87ee504e279e7bea31f2830d0c",
|
| 108514 |
+
"model_b_conv_id": "3bb6b5d40b5c43b18b52fd9fbef05c23",
|
| 108515 |
+
"inputs": {
|
| 108516 |
+
"prompt": "Melting Acid Smiley Face"
|
| 108517 |
+
},
|
| 108518 |
+
"model_a": "FLUX.1-schnell",
|
| 108519 |
+
"model_b": "PixArtAlpha",
|
| 108520 |
+
"vote_type": "tievote",
|
| 108521 |
+
"winner": "tie",
|
| 108522 |
+
"judge": "arena_user_10.16.31.254",
|
| 108523 |
+
"anony": true,
|
| 108524 |
+
"tstamp": 1733233379.1113
|
| 108525 |
+
},
|
| 108526 |
+
{
|
| 108527 |
+
"model_a_conv_id": "da2f92d735354727bd1df6f50cadbc4b",
|
| 108528 |
+
"model_b_conv_id": "95881f30f95e457fa5170c106e48529e",
|
| 108529 |
+
"inputs": {
|
| 108530 |
+
"prompt": "A long curved fruit which grows in clusters and has soft pulpy flesh and yellow skin when ripe."
|
| 108531 |
+
},
|
| 108532 |
+
"model_a": "FLUX.1-dev",
|
| 108533 |
+
"model_b": "HunyuanDiT",
|
| 108534 |
+
"vote_type": "leftvote",
|
| 108535 |
+
"winner": "model_a",
|
| 108536 |
+
"judge": "arena_user_10.20.38.195",
|
| 108537 |
+
"anony": true,
|
| 108538 |
+
"tstamp": 1733238198.0693
|
| 108539 |
+
},
|
| 108540 |
+
{
|
| 108541 |
+
"model_a_conv_id": "6e0a9c8288ac445996aefe1c77364092",
|
| 108542 |
+
"model_b_conv_id": "9b883821571446e6b11acd799e6f6d53",
|
| 108543 |
+
"inputs": {
|
| 108544 |
+
"prompt": "A domesticated carnivvorous mzammal that typicbally hfaas a lons sfnout, an acxujte sense off osmell, noneetractaaln crlaws, anid xbarkring,y howlingu, or whining rvoiche."
|
| 108545 |
+
},
|
| 108546 |
+
"model_a": "SDXL-Lightning",
|
| 108547 |
+
"model_b": "SD3",
|
| 108548 |
+
"vote_type": "leftvote",
|
| 108549 |
+
"winner": "model_a",
|
| 108550 |
+
"judge": "arena_user_10.20.14.72",
|
| 108551 |
+
"anony": true,
|
| 108552 |
+
"tstamp": 1733238222.7428
|
| 108553 |
+
},
|
| 108554 |
+
{
|
| 108555 |
+
"model_a_conv_id": "5714dc7d8c544d7c96e0c8ecb976f60a",
|
| 108556 |
+
"model_b_conv_id": "d2b1b1746e154e33b5e51c7c245692cb",
|
| 108557 |
+
"inputs": {
|
| 108558 |
+
"prompt": "A stop sign on the right of a refrigerator."
|
| 108559 |
+
},
|
| 108560 |
+
"model_a": "Kolors",
|
| 108561 |
+
"model_b": "SD3",
|
| 108562 |
+
"vote_type": "bothbad_vote",
|
| 108563 |
+
"winner": "tie (bothbad)",
|
| 108564 |
+
"judge": "arena_user_10.20.14.72",
|
| 108565 |
+
"anony": true,
|
| 108566 |
+
"tstamp": 1733238238.747
|
| 108567 |
+
},
|
| 108568 |
+
{
|
| 108569 |
+
"model_a_conv_id": "c930225a599149ffbc5a8a274503c0d8",
|
| 108570 |
+
"model_b_conv_id": "4d4a371132c94418a8d049fa4ed3c1dd",
|
| 108571 |
+
"inputs": {
|
| 108572 |
+
"prompt": "A storefront with 'Diffusion' written on it."
|
| 108573 |
+
},
|
| 108574 |
+
"model_a": "HunyuanDiT",
|
| 108575 |
+
"model_b": "FLUX.1-dev",
|
| 108576 |
+
"vote_type": "rightvote",
|
| 108577 |
+
"winner": "model_b",
|
| 108578 |
+
"judge": "arena_user_10.16.38.196",
|
| 108579 |
+
"anony": true,
|
| 108580 |
+
"tstamp": 1733243491.6852
|
| 108581 |
}
|
| 108582 |
]
|
arena_elo/results/latest/clean_battle_video_generation.json
CHANGED
|
@@ -33514,5 +33514,75 @@
|
|
| 33514 |
"judge": "arena_user_10.20.26.107",
|
| 33515 |
"anony": true,
|
| 33516 |
"tstamp": 1733070734.584
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 33517 |
}
|
| 33518 |
]
|
|
|
|
| 33514 |
"judge": "arena_user_10.20.26.107",
|
| 33515 |
"anony": true,
|
| 33516 |
"tstamp": 1733070734.584
|
| 33517 |
+
},
|
| 33518 |
+
{
|
| 33519 |
+
"model_a_conv_id": "ee3e60f17ad04c70b81aad1becb63667",
|
| 33520 |
+
"model_b_conv_id": "f501c72be457431584d633863a551140",
|
| 33521 |
+
"inputs": {
|
| 33522 |
+
"prompt": "baseball stadium"
|
| 33523 |
+
},
|
| 33524 |
+
"model_a": "AnimateDiff",
|
| 33525 |
+
"model_b": "AnimateDiff Turbo",
|
| 33526 |
+
"vote_type": "leftvote",
|
| 33527 |
+
"winner": "model_a",
|
| 33528 |
+
"judge": "arena_user_10.16.31.254",
|
| 33529 |
+
"anony": true,
|
| 33530 |
+
"tstamp": 1733159269.8212
|
| 33531 |
+
},
|
| 33532 |
+
{
|
| 33533 |
+
"model_a_conv_id": "b5953ec9903340938b2952fff1328b30",
|
| 33534 |
+
"model_b_conv_id": "d18e5e42f14d46e5aaf195a6325dff36",
|
| 33535 |
+
"inputs": {
|
| 33536 |
+
"prompt": "a bicycle accelerating to gain speed"
|
| 33537 |
+
},
|
| 33538 |
+
"model_a": "StableVideoDiffusion",
|
| 33539 |
+
"model_b": "T2V-Turbo",
|
| 33540 |
+
"vote_type": "rightvote",
|
| 33541 |
+
"winner": "model_b",
|
| 33542 |
+
"judge": "arena_user_10.16.38.136",
|
| 33543 |
+
"anony": true,
|
| 33544 |
+
"tstamp": 1733198045.5188
|
| 33545 |
+
},
|
| 33546 |
+
{
|
| 33547 |
+
"model_a_conv_id": "2202ca083adc4bba9620d94e4f9506fb",
|
| 33548 |
+
"model_b_conv_id": "3fd7456e22d04eb1a169819292d5482b",
|
| 33549 |
+
"inputs": {
|
| 33550 |
+
"prompt": "skis"
|
| 33551 |
+
},
|
| 33552 |
+
"model_a": "Allegro",
|
| 33553 |
+
"model_b": "T2V-Turbo",
|
| 33554 |
+
"vote_type": "rightvote",
|
| 33555 |
+
"winner": "model_b",
|
| 33556 |
+
"judge": "arena_user_10.16.3.13",
|
| 33557 |
+
"anony": true,
|
| 33558 |
+
"tstamp": 1733198076.8266
|
| 33559 |
+
},
|
| 33560 |
+
{
|
| 33561 |
+
"model_a_conv_id": "3e2162aec4a4446fb25440be6c1441e7",
|
| 33562 |
+
"model_b_conv_id": "820f54f94a94426e8984e2f4572dec77",
|
| 33563 |
+
"inputs": {
|
| 33564 |
+
"prompt": "a giraffe"
|
| 33565 |
+
},
|
| 33566 |
+
"model_a": "Pyramid Flow",
|
| 33567 |
+
"model_b": "LTXVideo",
|
| 33568 |
+
"vote_type": "leftvote",
|
| 33569 |
+
"winner": "model_a",
|
| 33570 |
+
"judge": "arena_user_10.16.12.226",
|
| 33571 |
+
"anony": true,
|
| 33572 |
+
"tstamp": 1733242110.7029
|
| 33573 |
+
},
|
| 33574 |
+
{
|
| 33575 |
+
"model_a_conv_id": "c272f3769e474d96afddac74c4ddc4ba",
|
| 33576 |
+
"model_b_conv_id": "6cd7a09ac7164f4d9a2dbfe8b30ebf82",
|
| 33577 |
+
"inputs": {
|
| 33578 |
+
"prompt": "Origami dancers in white paper, 3D render, on white background, studio shot, dancing modern dance."
|
| 33579 |
+
},
|
| 33580 |
+
"model_a": "AnimateDiff",
|
| 33581 |
+
"model_b": "CogVideoX-2B",
|
| 33582 |
+
"vote_type": "bothbad_vote",
|
| 33583 |
+
"winner": "tie (bothbad)",
|
| 33584 |
+
"judge": "arena_user_10.16.30.109",
|
| 33585 |
+
"anony": true,
|
| 33586 |
+
"tstamp": 1733243540.6572
|
| 33587 |
}
|
| 33588 |
]
|
arena_elo/results/latest/elo_results_t2i_generation.pkl
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f5f79d98bb3a09431dd74dc406320e7245304dd008ff2ab2a63658a3b3ed860e
|
| 3 |
+
size 88250
|
arena_elo/results/latest/elo_results_video_generation.pkl
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 75108
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2d08dd5edb096da37bbac4877e9092341349851b711ee9d6b2136fa30e2e2750
|
| 3 |
size 75108
|
arena_elo/results/latest/t2i_generation_leaderboard.csv
CHANGED
|
@@ -1,18 +1,18 @@
|
|
| 1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
| 2 |
-
PlayGround V2.5,PlayGround V2.5,1121.
|
| 3 |
-
FLUX.1-dev,FLUX.1-dev,
|
| 4 |
-
FLUX.1-schnell,FLUX.1-schnell,
|
| 5 |
-
PlayGround V2,PlayGround V2,1073.
|
| 6 |
-
Kolors,Kolors,1052.
|
| 7 |
-
StableCascade,StableCascade,1040.
|
| 8 |
-
HunyuanDiT,HunyuanDiT,
|
| 9 |
-
PixArtAlpha,PixArtAlpha,1019.
|
| 10 |
-
SDXL-Lightning,SDXL-Lightning,1019.
|
| 11 |
-
PixArtSigma,PixArtSigma,1018.
|
| 12 |
-
SD3,SD3,
|
| 13 |
-
AuraFlow,AuraFlow,1004.
|
| 14 |
-
SDXL,SDXL,967.
|
| 15 |
-
SDXLTurbo,SDXLTurbo,915.
|
| 16 |
-
LCM(v1.5/XL),LCM(v1.5/XL),905.
|
| 17 |
-
OpenJourney,OpenJourney,832.
|
| 18 |
-
LCM,LCM,791.
|
|
|
|
| 1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
| 2 |
+
PlayGround V2.5,PlayGround V2.5,1121.0280133870144,1120.7165643560843,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
|
| 3 |
+
FLUX.1-dev,FLUX.1-dev,1119.76898699982,1139.6958331226583,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
|
| 4 |
+
FLUX.1-schnell,FLUX.1-schnell,1084.4060775713206,1075.2377635535684,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
|
| 5 |
+
PlayGround V2,PlayGround V2,1073.166017371307,1071.6479361169622,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
|
| 6 |
+
Kolors,Kolors,1052.716930806343,1051.3686171448594,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
|
| 7 |
+
StableCascade,StableCascade,1040.772440746402,1042.5792731490517,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
|
| 8 |
+
HunyuanDiT,HunyuanDiT,1027.904562748024,1020.7701445774316,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
|
| 9 |
+
PixArtAlpha,PixArtAlpha,1019.8078652983697,1010.8656349081784,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
|
| 10 |
+
SDXL-Lightning,SDXL-Lightning,1019.4615300489322,1022.0258326668156,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
|
| 11 |
+
PixArtSigma,PixArtSigma,1018.0544278583469,1017.3857308872836,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
|
| 12 |
+
SD3,SD3,1006.0486374544896,1008.966771056853,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
|
| 13 |
+
AuraFlow,AuraFlow,1004.2215162640015,999.0581930328785,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
|
| 14 |
+
SDXL,SDXL,967.104416616448,966.8787344387692,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
|
| 15 |
+
SDXLTurbo,SDXLTurbo,915.7461645573251,912.8653839131264,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
|
| 16 |
+
LCM(v1.5/XL),LCM(v1.5/XL),905.8707857250673,899.2438562320352,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
|
| 17 |
+
OpenJourney,OpenJourney,832.7813140066881,826.9804611621538,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
|
| 18 |
+
LCM,LCM,791.1403125400976,804.6812350769155,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
|
arena_elo/results/latest/video_generation_leaderboard.csv
CHANGED
|
@@ -1,14 +1,14 @@
|
|
| 1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
| 2 |
-
CogVideoX-5B,CogVideoX-5B,1160.
|
| 3 |
-
Pyramid Flow,Pyramid Flow,1144.
|
| 4 |
-
StableVideoDiffusion,StableVideoDiffusion,
|
| 5 |
-
CogVideoX-2B,CogVideoX-2B,1059.
|
| 6 |
-
T2V-Turbo,T2V-Turbo,
|
| 7 |
-
AnimateDiff,AnimateDiff,
|
| 8 |
-
VideoCrafter2,VideoCrafter2,1039.
|
| 9 |
-
Allegro,Allegro,
|
| 10 |
-
LaVie,LaVie,
|
| 11 |
-
OpenSora,OpenSora,
|
| 12 |
-
OpenSora v1.2,OpenSora v1.2,
|
| 13 |
-
AnimateDiff Turbo,AnimateDiff Turbo,835.
|
| 14 |
-
ModelScope,ModelScope,
|
|
|
|
| 1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
| 2 |
+
CogVideoX-5B,CogVideoX-5B,1160.9798558528043,1155.2825017564596,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
|
| 3 |
+
Pyramid Flow,Pyramid Flow,1144.4443150788584,1147.2395781116793,MIT LICENSE,Peking University,https://pyramid-flow.github.io/
|
| 4 |
+
StableVideoDiffusion,StableVideoDiffusion,1123.5142921556,1125.9492939358383,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
|
| 5 |
+
CogVideoX-2B,CogVideoX-2B,1059.4199799072226,1055.7878886216029,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
|
| 6 |
+
T2V-Turbo,T2V-Turbo,1055.141819717971,1054.473560987793,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
|
| 7 |
+
AnimateDiff,AnimateDiff,1043.18176646356,1041.909276574398,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
|
| 8 |
+
VideoCrafter2,VideoCrafter2,1039.650649385956,1040.368902202116,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
|
| 9 |
+
Allegro,Allegro,1001.1069655520251,1003.8077700559775,Apache 2.0,rhymes-ai,https://github.com/rhymes-ai/Allegro
|
| 10 |
+
LaVie,LaVie,969.0713041833375,969.634777080319,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
|
| 11 |
+
OpenSora,OpenSora,885.2459765161428,885.6299788044697,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
|
| 12 |
+
OpenSora v1.2,OpenSora v1.2,847.2049389414091,846.1074362119856,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
|
| 13 |
+
AnimateDiff Turbo,AnimateDiff Turbo,835.9335206139747,836.747355723456,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
|
| 14 |
+
ModelScope,ModelScope,835.1046156311368,837.0616799339045,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
|