Models

pytorch/gemma-3-12b-it-QAT-INT4

Image-Text-to-Text • Updated 8 days ago • 49 • 3

pytorch/Phi-4-mini-instruct-AWQ-INT4

Text Generation • Updated 19 days ago • 3.2k • 3

pytorch/gemma-3-27b-it-AWQ-INT4

Image-Text-to-Text • Updated 18 days ago • 3.64k • 2

pytorch/Qwen3-8B-QAT-INT4

Text Generation • Updated 8 days ago • 404 • 1

pytorch/Phi-4-mini-instruct-INT8-INT4

Text Generation • Updated Sep 11 • 2.09k • 2

pytorch/Phi-4-mini-instruct-INT4

Text Generation • Updated 19 days ago • 91

pytorch/Phi-4-mini-instruct-FP8

Text Generation • Updated 19 days ago • 874 • 1

pytorch/Qwen3-8B-INT4

Text Generation • Updated 19 days ago • 151 • 2

pytorch/Qwen3-32B-FP8

Text Generation • Updated 19 days ago • 64

pytorch/Qwen3-4B-INT8-INT4

Text Generation • Updated Sep 11 • 1.99k • 2

pytorch/SmolLM3-3B-INT8-INT4

Text Generation • Updated Sep 11 • 57 • 37

jerryzh168/Qwen3-8B-FP8

Text Generation • Updated Sep 9 • 11

jerryzh168/Qwen3-8B-INT4-non-hqq

Text Generation • Updated Aug 29 • 11

jerryzh168/Qwen3-8B-INT8-INT4

Text Generation • Updated Sep 9 • 11

q10/Qwen3-8B-Base-FP8

Text Generation • Updated Aug 25 • 11

q10/Qwen3-8B-Base-INT4

Text Generation • Updated Aug 25 • 14

q10/Qwen3-8B-Base-INT8-INT4

Text Generation • Updated Aug 25 • 11

pytorch/gemma-3-12b-it-INT4

Image-Text-to-Text • Updated 13 days ago • 151

pytorch/gemma-3-12b-it-FP8

Image-Text-to-Text • Updated 13 days ago • 201

pytorch/gemma-3-27b-it-FP8

Image-Text-to-Text • Updated 11 days ago • 448 • 2

pytorch/gemma-3-27b-it-INT4

Image-Text-to-Text • Updated 13 days ago • 366

pytorch/Qwen3-8B-AWQ-INT4

Text Generation • Updated 19 days ago • 159 • 1

jerryzh168/Qwen3-8B-INT4

Text Generation • Updated Sep 10 • 306

namgyu-youn/Qwen3-8B-SMOOTHQUANT-W8A8

Text Generation • Updated Sep 17 • 3

namgyu-youn/Phi-4-mini-instruct-AWQ-INT4

Text Generation • Updated Sep 17 • 4

jerryzh168/Qwen3-4B-FP8

Text Generation • Updated Sep 19 • 2

jerryzh168/Qwen3-4B-INT4

Text Generation • Updated Sep 19 • 2

jerryzh168/Qwen3-4B-INT8-INT4

Text Generation • Updated Sep 19 • 4

pytorch/gemma-3-12b-it-AWQ-INT4

Image-Text-to-Text • Updated 18 days ago • 1.1k

jerryzh168/gemma-3-12b-it-INT4

Image-Text-to-Text • Updated 18 days ago • 37