mradermacher
/

Yi-1.5-34B-Chat-16K-i1-GGUF

Model card Files Files and versions

Yi-1.5-34B-Chat-16K-i1-GGUF

345 GB

1 contributor

History: 29 commits

mradermacher's picture

auto-patch README.md

9da84ef verified about 1 year ago

.gitattributes

3.12 kB

uploaded from kaos about 1 year ago
README.md

5.23 kB

auto-patch README.md about 1 year ago
Yi-1.5-34B-Chat-16K.i1-IQ1_M.gguf

8.18 GB
xet

uploaded from nethype/db3 over 1 year ago
Yi-1.5-34B-Chat-16K.i1-IQ1_S.gguf

7.5 GB
xet

uploaded from nethype/db3 over 1 year ago
Yi-1.5-34B-Chat-16K.i1-IQ2_M.gguf

11.8 GB
xet

uploaded from nethype/db3 over 1 year ago
Yi-1.5-34B-Chat-16K.i1-IQ2_S.gguf

10.9 GB
xet

uploaded from nethype/db3 over 1 year ago
Yi-1.5-34B-Chat-16K.i1-IQ2_XS.gguf

10.3 GB
xet

uploaded from nethype/db3 over 1 year ago
Yi-1.5-34B-Chat-16K.i1-IQ2_XXS.gguf

9.31 GB
xet

uploaded from nethype/db3 over 1 year ago
Yi-1.5-34B-Chat-16K.i1-IQ3_M.gguf

15.6 GB
xet

uploaded from nethype/db3 over 1 year ago
Yi-1.5-34B-Chat-16K.i1-IQ3_S.gguf

15 GB
xet

uploaded from nethype/db3 over 1 year ago
Yi-1.5-34B-Chat-16K.i1-IQ3_XS.gguf

14.2 GB
xet

uploaded from nethype/db3 over 1 year ago
Yi-1.5-34B-Chat-16K.i1-IQ3_XXS.gguf

13.3 GB
xet

uploaded from nethype/db3 over 1 year ago
Yi-1.5-34B-Chat-16K.i1-IQ4_XS.gguf

18.5 GB
xet

uploaded from nethype/db3 over 1 year ago
Yi-1.5-34B-Chat-16K.i1-Q2_K.gguf

12.8 GB
xet

uploaded from nethype/db3 over 1 year ago
Yi-1.5-34B-Chat-16K.i1-Q2_K_S.gguf

11.9 GB
xet

uploaded from kaos about 1 year ago
Yi-1.5-34B-Chat-16K.i1-Q3_K_L.gguf

18.1 GB
xet

uploaded from nethype/db3 over 1 year ago
Yi-1.5-34B-Chat-16K.i1-Q3_K_M.gguf

16.7 GB
xet

uploaded from nethype/db3 over 1 year ago
Yi-1.5-34B-Chat-16K.i1-Q3_K_S.gguf

15 GB
xet

uploaded from nethype/db3 over 1 year ago
Yi-1.5-34B-Chat-16K.i1-Q4_0.gguf

19.5 GB
xet

uploaded from nethype/db3 over 1 year ago
Yi-1.5-34B-Chat-16K.i1-Q4_K_M.gguf

20.7 GB
xet

uploaded from nethype/db3 over 1 year ago
Yi-1.5-34B-Chat-16K.i1-Q4_K_S.gguf

19.6 GB
xet

uploaded from nethype/db3 over 1 year ago
Yi-1.5-34B-Chat-16K.i1-Q5_K_M.gguf

24.3 GB
xet

uploaded from nethype/db3 over 1 year ago
Yi-1.5-34B-Chat-16K.i1-Q5_K_S.gguf

23.7 GB
xet

uploaded from nethype/db3 over 1 year ago
Yi-1.5-34B-Chat-16K.i1-Q6_K.gguf

28.2 GB
xet

uploaded from nethype/db3 over 1 year ago
imatrix.dat

15.3 MB
xet

uploaded from nethype/db3 over 1 year ago