Does this i1-Q4_K_M.GGUF version exist?

Beginners
1

I’m looking for a i1-Q4_K_M.GGUF version of Qwen/Qwen2.5-7B. Does anyone know if it exists? If it does, then can I please get a link?

1 Like
2

e.g. : https://huggingface.co/mradermacher/Qwen2.5-7B-i1-GGUF/blob/main/Qwen2.5-7B.i1-Q4_K_M.gguf

3

How to find :

find_i_quant1
find_i_quant11053×802 156 KB

4

Impish_QWEN_7B-Q4_K_M isn’t working on KoboldCcp. I have Qwen2.5-7B.i1-Q4_K_M on my computer, but it still keeps on saying that the text model cannot load. What am I doing wrong and how do I fix it?

1 Like