Mungert
/

granite-4.0-micro-base-GGUF

Model card Files Files and versions

granite-4.0-micro-base-GGUF

55.5 GB

1 contributor

History: 29 commits

Mungert's picture

Upload granite-4.0-micro-base-bf16.gguf with huggingface_hub

e4c8517 verified 12 days ago

.gitattributes

3.42 kB

Upload granite-4.0-micro-base-bf16.gguf with huggingface_hub 12 days ago
README.md

31.5 kB

Upload README.md with huggingface_hub 12 days ago
granite-4.0-micro-base-bf16.gguf

6.81 GB
xet

Upload granite-4.0-micro-base-bf16.gguf with huggingface_hub 12 days ago
granite-4.0-micro-base-f16_q8_0.gguf

4.94 GB
xet

Upload granite-4.0-micro-base-f16_q8_0.gguf with huggingface_hub 12 days ago
granite-4.0-micro-base-imatrix.gguf

3.81 MB
xet

Upload granite-4.0-micro-base-imatrix.gguf with huggingface_hub 12 days ago
granite-4.0-micro-base-iq1_m.gguf

1.07 GB
xet

Upload granite-4.0-micro-base-iq1_m.gguf with huggingface_hub 12 days ago
granite-4.0-micro-base-iq1_s.gguf

961 MB
xet

Upload granite-4.0-micro-base-iq1_s.gguf with huggingface_hub 12 days ago
granite-4.0-micro-base-iq2_m.gguf

1.28 GB
xet

Upload granite-4.0-micro-base-iq2_m.gguf with huggingface_hub 12 days ago
granite-4.0-micro-base-iq2_s.gguf

1.23 GB
xet

Upload granite-4.0-micro-base-iq2_s.gguf with huggingface_hub 12 days ago
granite-4.0-micro-base-iq2_xs.gguf

1.19 GB
xet

Upload granite-4.0-micro-base-iq2_xs.gguf with huggingface_hub 12 days ago
granite-4.0-micro-base-iq2_xxs.gguf

1.1 GB
xet

Upload granite-4.0-micro-base-iq2_xxs.gguf with huggingface_hub 12 days ago
granite-4.0-micro-base-iq3_m.gguf

1.67 GB
xet

Upload granite-4.0-micro-base-iq3_m.gguf with huggingface_hub 12 days ago
granite-4.0-micro-base-iq3_xs.gguf

1.51 GB
xet

Upload granite-4.0-micro-base-iq3_xs.gguf with huggingface_hub 12 days ago
granite-4.0-micro-base-iq3_xxs.gguf

1.47 GB
xet

Upload granite-4.0-micro-base-iq3_xxs.gguf with huggingface_hub 12 days ago
granite-4.0-micro-base-iq4_nl.gguf

1.92 GB
xet

Upload granite-4.0-micro-base-iq4_nl.gguf with huggingface_hub 12 days ago
granite-4.0-micro-base-iq4_xs.gguf

1.89 GB
xet

Upload granite-4.0-micro-base-iq4_xs.gguf with huggingface_hub 12 days ago
granite-4.0-micro-base-q2_k_m.gguf

1.32 GB
xet

Upload granite-4.0-micro-base-q2_k_m.gguf with huggingface_hub 12 days ago
granite-4.0-micro-base-q2_k_s.gguf

1.29 GB
xet

Upload granite-4.0-micro-base-q2_k_s.gguf with huggingface_hub 12 days ago
granite-4.0-micro-base-q3_k_m.gguf

1.71 GB
xet

Upload granite-4.0-micro-base-q3_k_m.gguf with huggingface_hub 12 days ago
granite-4.0-micro-base-q3_k_s.gguf

1.68 GB
xet

Upload granite-4.0-micro-base-q3_k_s.gguf with huggingface_hub 12 days ago
granite-4.0-micro-base-q4_0.gguf

2.05 GB
xet

Upload granite-4.0-micro-base-q4_0.gguf with huggingface_hub 12 days ago
granite-4.0-micro-base-q4_1.gguf

2.15 GB
xet

Upload granite-4.0-micro-base-q4_1.gguf with huggingface_hub 12 days ago
granite-4.0-micro-base-q4_k_m.gguf

2.14 GB
xet

Upload granite-4.0-micro-base-q4_k_m.gguf with huggingface_hub 12 days ago
granite-4.0-micro-base-q4_k_s.gguf

2.02 GB
xet

Upload granite-4.0-micro-base-q4_k_s.gguf with huggingface_hub 12 days ago
granite-4.0-micro-base-q5_0.gguf

2.44 GB
xet

Upload granite-4.0-micro-base-q5_0.gguf with huggingface_hub 12 days ago
granite-4.0-micro-base-q5_1.gguf

2.64 GB
xet

Upload granite-4.0-micro-base-q5_1.gguf with huggingface_hub 12 days ago
granite-4.0-micro-base-q5_k_m.gguf

2.51 GB
xet

Upload granite-4.0-micro-base-q5_k_m.gguf with huggingface_hub 12 days ago
granite-4.0-micro-base-q6_k_m.gguf

2.86 GB
xet

Upload granite-4.0-micro-base-q6_k_m.gguf with huggingface_hub 12 days ago
granite-4.0-micro-base-q8_0.gguf

3.62 GB
xet

Upload granite-4.0-micro-base-q8_0.gguf with huggingface_hub 12 days ago