RuntimeError: qweight and qzeros have incompatible shapes.
#6 opened over 1 year ago
by
bpandey23
[AUTOMATED] Model Memory Requirements
#5 opened almost 2 years ago
by
model-sizer-bot
Which dataset did you use to quantise this model?
#4 opened almost 2 years ago
by
deepak-banka
KoboldAI - The model entered does not exist
#3 opened almost 2 years ago
by
statistx
Running Zyphyr-7B-beta locally for QnA Chat
2
#2 opened about 2 years ago
by
riyazmuthyalapati
Context Length and Max New Tokens
3
#1 opened about 2 years ago
by
Shivam098