bartowski
/

ibm-granite_granite-4.0-micro-GGUF

Text Generation

Model card Files Files and versions

ibm-granite_granite-4.0-micro-GGUF

53.4 GB

1 contributor

History: 25 commits

bartowski's picture

Upload ibm-granite_granite-4.0-micro-bf16.gguf with huggingface_hub

b72eb70 verified 3 months ago

.gitattributes

3.38 kB

Upload ibm-granite_granite-4.0-micro-bf16.gguf with huggingface_hub 3 months ago
ibm-granite_granite-4.0-micro-IQ2_M.gguf

1.24 GB
xet

Upload ibm-granite_granite-4.0-micro-IQ2_M.gguf with huggingface_hub 3 months ago
ibm-granite_granite-4.0-micro-IQ3_M.gguf

1.62 GB
xet

Upload ibm-granite_granite-4.0-micro-IQ3_M.gguf with huggingface_hub 3 months ago
ibm-granite_granite-4.0-micro-IQ3_XS.gguf

1.5 GB
xet

Upload ibm-granite_granite-4.0-micro-IQ3_XS.gguf with huggingface_hub 3 months ago
ibm-granite_granite-4.0-micro-IQ3_XXS.gguf

1.39 GB
xet

Upload ibm-granite_granite-4.0-micro-IQ3_XXS.gguf with huggingface_hub 3 months ago
ibm-granite_granite-4.0-micro-IQ4_NL.gguf

1.99 GB
xet

Upload ibm-granite_granite-4.0-micro-IQ4_NL.gguf with huggingface_hub 3 months ago
ibm-granite_granite-4.0-micro-IQ4_XS.gguf

1.89 GB
xet

Upload ibm-granite_granite-4.0-micro-IQ4_XS.gguf with huggingface_hub 3 months ago
ibm-granite_granite-4.0-micro-Q2_K.gguf

1.37 GB
xet

Upload ibm-granite_granite-4.0-micro-Q2_K.gguf with huggingface_hub 3 months ago
ibm-granite_granite-4.0-micro-Q2_K_L.gguf

1.43 GB
xet

Upload ibm-granite_granite-4.0-micro-Q2_K_L.gguf with huggingface_hub 3 months ago
ibm-granite_granite-4.0-micro-Q3_K_L.gguf

1.86 GB
xet

Upload ibm-granite_granite-4.0-micro-Q3_K_L.gguf with huggingface_hub 3 months ago
ibm-granite_granite-4.0-micro-Q3_K_M.gguf

1.73 GB
xet

Upload ibm-granite_granite-4.0-micro-Q3_K_M.gguf with huggingface_hub 3 months ago
ibm-granite_granite-4.0-micro-Q3_K_S.gguf

1.57 GB
xet

Upload ibm-granite_granite-4.0-micro-Q3_K_S.gguf with huggingface_hub 3 months ago
ibm-granite_granite-4.0-micro-Q3_K_XL.gguf

1.93 GB
xet

Upload ibm-granite_granite-4.0-micro-Q3_K_XL.gguf with huggingface_hub 3 months ago
ibm-granite_granite-4.0-micro-Q4_0.gguf

1.99 GB
xet

Upload ibm-granite_granite-4.0-micro-Q4_0.gguf with huggingface_hub 3 months ago
ibm-granite_granite-4.0-micro-Q4_1.gguf

2.18 GB
xet

Upload ibm-granite_granite-4.0-micro-Q4_1.gguf with huggingface_hub 3 months ago
ibm-granite_granite-4.0-micro-Q4_K_L.gguf

2.16 GB
xet

Upload ibm-granite_granite-4.0-micro-Q4_K_L.gguf with huggingface_hub 3 months ago
ibm-granite_granite-4.0-micro-Q4_K_M.gguf

2.1 GB
xet

Upload ibm-granite_granite-4.0-micro-Q4_K_M.gguf with huggingface_hub 3 months ago
ibm-granite_granite-4.0-micro-Q4_K_S.gguf

2 GB
xet

Upload ibm-granite_granite-4.0-micro-Q4_K_S.gguf with huggingface_hub 3 months ago
ibm-granite_granite-4.0-micro-Q5_K_L.gguf

2.5 GB
xet

Upload ibm-granite_granite-4.0-micro-Q5_K_L.gguf with huggingface_hub 3 months ago
ibm-granite_granite-4.0-micro-Q5_K_M.gguf

2.44 GB
xet

Upload ibm-granite_granite-4.0-micro-Q5_K_M.gguf with huggingface_hub 3 months ago
ibm-granite_granite-4.0-micro-Q5_K_S.gguf

2.38 GB
xet

Upload ibm-granite_granite-4.0-micro-Q5_K_S.gguf with huggingface_hub 3 months ago
ibm-granite_granite-4.0-micro-Q6_K.gguf

2.8 GB
xet

Upload ibm-granite_granite-4.0-micro-Q6_K.gguf with huggingface_hub 3 months ago
ibm-granite_granite-4.0-micro-Q6_K_L.gguf

2.86 GB
xet

Upload ibm-granite_granite-4.0-micro-Q6_K_L.gguf with huggingface_hub 3 months ago
ibm-granite_granite-4.0-micro-Q8_0.gguf

3.62 GB
xet

Upload ibm-granite_granite-4.0-micro-Q8_0.gguf with huggingface_hub 3 months ago
ibm-granite_granite-4.0-micro-bf16.gguf

6.81 GB
xet

Upload ibm-granite_granite-4.0-micro-bf16.gguf with huggingface_hub 3 months ago