Sandbo Chang
Sandbo
AI & ML interests
None yet
Organizations
None yet
Request: 4-bit GPTQ or AWQ quantized version of openai/gpt-oss-20b
π
β€οΈ
16
12
#32 opened 5 months ago
by
powtac
This quant is giving gibberish result in vLLM
4
#1 opened 6 months ago
by
Sandbo
Would there by bnb version for the UD quants?
2
#5 opened 6 months ago
by
Sandbo
I get errors trying to deploy this in vllm or sglang.
π
π
7
3
#1 opened 8 months ago
by
chriswritescode