Quantized Models (GGUF, IQ, Imatrix)
Collection
Various GGUF quantizations of small models. Models with a "checkmark" are personal favorites. An "orange arrow" means it's being uploaded. • 97 items • Updated
• 69
Formatting might be "chaotic".
Hello, travelers!
These are my GGUF-IQ-Imatrix quants of Captain-Eris_Violet-GRPO-v0.420.
Discussions
- General discussion and author feedback.
Feedback is always welcome for potential issues with quants and as a way to guide the author in the future iterations.
Your comments for them are appreciated!
SillyTavern
- [SillyTavern Presets]
Initially recommended master-import presets.
⛶ [Expand/Collapse] Additional setup.
SillyTavern Reasoning Block Parsing Example...
- Downloads last month
- 141
Hardware compatibility
Log In to add your hardware
3-bit
4-bit
5-bit
6-bit
8-bit
16-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support