Update README.md
Browse filesAdded quants, thanks to the amazing LoneStriker!
README.md
CHANGED
|
@@ -16,7 +16,9 @@ tags:
|
|
| 16 |
|
| 17 |

|
| 18 |
|
| 19 |
-
*
|
|
|
|
|
|
|
| 20 |
|
| 21 |
This is a 120b frankenmerge of [miqu-1-70b](https://huggingface.co/miqudev/miqu-1-70b) created by interleaving layers of [miqu-1-70b-sf](https://huggingface.co/152334H/miqu-1-70b-sf) with itself using [mergekit](https://github.com/cg123/mergekit).
|
| 22 |
|
|
@@ -24,6 +26,8 @@ Inspired by [Venus-120b-v1.2](https://huggingface.co/nsfwthrowitaway69/Venus-120
|
|
| 24 |
|
| 25 |
Thanks for the support, [CopilotKit](https://github.com/CopilotKit/CopilotKit) - the open-source platform for building in-app AI Copilots into any product, with any LLM model. Check out their GitHub.
|
| 26 |
|
|
|
|
|
|
|
| 27 |
## Prompt template: Mistral
|
| 28 |
|
| 29 |
```
|
|
|
|
| 16 |
|
| 17 |

|
| 18 |
|
| 19 |
+
* EXL2: [2.4bpw](https://huggingface.co/LoneStriker/wolfram_miqu-1-120b-2.4bpw-h6-exl2) | [2.65bpw](https://huggingface.co/LoneStriker/wolfram_miqu-1-120b-2.65bpw-h6-exl2) | 3.0bpw | [4.0bpw](https://huggingface.co/LoneStriker/wolfram_miqu-1-120b-4.0bpw-h6-exl2) | [5.0bpw](https://huggingface.co/LoneStriker/wolfram_miqu-1-120b-5.0bpw-h6-exl2)
|
| 20 |
+
* GGUF: [Q2_K-Q5_K_M](https://huggingface.co/LoneStriker/wolfram_miqu-1-120b-GGUF/) | [IQ3_XXS](https://huggingface.co/wolfram/miqu-1-120b-GGUF)
|
| 21 |
+
* HF FP16: [wolfram/miqu-1-120b](https://huggingface.co/wolfram/miqu-1-120b)
|
| 22 |
|
| 23 |
This is a 120b frankenmerge of [miqu-1-70b](https://huggingface.co/miqudev/miqu-1-70b) created by interleaving layers of [miqu-1-70b-sf](https://huggingface.co/152334H/miqu-1-70b-sf) with itself using [mergekit](https://github.com/cg123/mergekit).
|
| 24 |
|
|
|
|
| 26 |
|
| 27 |
Thanks for the support, [CopilotKit](https://github.com/CopilotKit/CopilotKit) - the open-source platform for building in-app AI Copilots into any product, with any LLM model. Check out their GitHub.
|
| 28 |
|
| 29 |
+
Thanks for the EXL2 and GGUF quants, [Lone Striker](https://huggingface.co/LoneStriker)!
|
| 30 |
+
|
| 31 |
## Prompt template: Mistral
|
| 32 |
|
| 33 |
```
|