Mungert
/

granite-3.1-2b-instruct-GGUF

Text Generation

Model card Files Files and versions

granite-3.1-2b-instruct-GGUF

40.2 GB

1 contributor

History: 1 commit

Mungert's picture

Super-squash history to reclaim storage

ee57e72 verified 4 months ago

.gitattributes
4.03 kB

Super-squash history to reclaim storage 4 months ago
README.md
24.4 kB

Super-squash history to reclaim storage 4 months ago
granite-3.1-2b-instruct-bf16.gguf
5.07 GB
xet

Super-squash history to reclaim storage 4 months ago
granite-3.1-2b-instruct-bf16_q8_0.gguf
3.61 GB
xet

Super-squash history to reclaim storage 4 months ago
granite-3.1-2b-instruct-f16_q8_0.gguf
3.61 GB
xet

Super-squash history to reclaim storage 4 months ago
granite-3.1-2b-instruct-iq3_m.gguf
1.2 GB
xet

Super-squash history to reclaim storage 4 months ago
granite-3.1-2b-instruct-iq3_s.gguf
1.2 GB
xet

Super-squash history to reclaim storage 4 months ago
granite-3.1-2b-instruct-iq3_xs.gguf
1.07 GB
xet

Super-squash history to reclaim storage 4 months ago
granite-3.1-2b-instruct-iq3_xxs.gguf
1.05 GB
xet

Super-squash history to reclaim storage 4 months ago
granite-3.1-2b-instruct-iq4_nl.gguf
1.46 GB
xet

Super-squash history to reclaim storage 4 months ago
granite-3.1-2b-instruct-iq4_xs.gguf
1.38 GB
xet

Super-squash history to reclaim storage 4 months ago
granite-3.1-2b-instruct-q3_k_m.gguf
1.24 GB
xet

Super-squash history to reclaim storage 4 months ago
granite-3.1-2b-instruct-q3_k_s.gguf
1.23 GB
xet

Super-squash history to reclaim storage 4 months ago
granite-3.1-2b-instruct-q4_0.gguf
1.43 GB
xet

Super-squash history to reclaim storage 4 months ago
granite-3.1-2b-instruct-q4_1.gguf
1.59 GB
xet

Super-squash history to reclaim storage 4 months ago
granite-3.1-2b-instruct-q4_k_m.gguf
1.53 GB
xet

Super-squash history to reclaim storage 4 months ago
granite-3.1-2b-instruct-q4_k_s.gguf
1.48 GB
xet

Super-squash history to reclaim storage 4 months ago
granite-3.1-2b-instruct-q5_0.gguf
1.74 GB
xet

Super-squash history to reclaim storage 4 months ago
granite-3.1-2b-instruct-q5_1.gguf
1.9 GB
xet

Super-squash history to reclaim storage 4 months ago
granite-3.1-2b-instruct-q5_k_m.gguf
1.81 GB
xet

Super-squash history to reclaim storage 4 months ago
granite-3.1-2b-instruct-q5_k_s.gguf
1.78 GB
xet

Super-squash history to reclaim storage 4 months ago
granite-3.1-2b-instruct-q6_k_m.gguf
2.08 GB
xet

Super-squash history to reclaim storage 4 months ago
granite-3.1-2b-instruct-q8_0.gguf
2.69 GB
xet

Super-squash history to reclaim storage 4 months ago
granite-3.1-2b-instruct.imatrix
3.29 MB
xet

Super-squash history to reclaim storage 4 months ago