turboderp's picture
Update README.md
795e203 verified
metadata
license: cc-by-nc-4.0
base_model: CohereLabs/c4ai-command-r-08-2024
base_model_relation: quantized
quantized_by: turboderp
tags:
  - exl3

EXL3 quants of C4AI Command R 08-2024

2.00 bits per weight
2.50 bits per weight
3.00 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
8.00 bits per weight / H8

image/png