Qwen or not?
#1
by
clover-supply
- opened
The model page says it's based on Qwen but when I try to gguf the model it says the architecture is not supported? Is it too much differrent now?
Yes, it's based on Qwen2.5. However, as described in the technical report, we apply a PMA layer on top of the model, so you will need to load with trust_remote_code=True.