Phi 3.5 mini model with all the GGUF quantizations
Chat template
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
16-bit
32-bit