Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

mixed-quantization

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

30

Base only

Active filters: mixed-quantization

shamidk/apex-flash-1-abliterated-DS4-Q2-GGUF

Text Generation • 321B • Updated 7 days ago • 302 • 2

shamidk/apex-flash-1-DS4-Q2-GGUF

Text Generation • 321B • Updated 7 days ago • 287 • 1

shieldstackllc/Step-3.5-Flash-REAP-128B-A11B-mlx-mixed-4-6

Text Generation • 121B • Updated Feb 16 • 33

GOBA-AI-Labs/PrunedHub-Qwen3-30B-A3B-EN-80pct-MxMoE

Text Generation • 25B • Updated Feb 23 • 26

GOBA-AI-Labs/PrunedHub-Qwen3-30B-A3B-JP-80pct-MxMoE

Text Generation • 25B • Updated Feb 23 • 17

Phipper/qwen3.5-27b-opus-distilled-proposal-c

Text Generation • 27B • Updated Apr 2 • 16

Asystemoffields/Qwen3-1.7B-PMRA-IQ3XS-budget-GGUF

Text Generation • 2B • Updated Jun 2 • 29

Asystemoffields/gemma-4-E2B-it-PMRA-GGUF

Text Generation • 5B • Updated Jun 2 • 57

andrzejmontano/Qwen3-VL-Embedding-8B-mlx-8bit

Sentence Similarity • 9B • Updated May 14 • 68

Asystemoffields/Huihui-Qwen3.5-4B-Abliterated-PMRA-GGUF

Text Generation • 4B • Updated Jun 2 • 112

Asystemoffields/Ministral-3-8B-Instruct-PMRA-GGUF

Text Generation • 8B • Updated Jun 2 • 37 • 1

Asystemoffields/IBM-granite-4.1-8b-heretic-PMRA-GGUF

Text Generation • 8B • Updated Jun 2 • 20 • 1

TheGreatQuran/QuranKarim-SpeechToText-onnxModel

Automatic Speech Recognition • Updated Jul 31

andrzejmontano/tmax-27b-MTP-vision-BF16-8bit

Image-Text-to-Text • 28B • Updated Jun 26 • 12 • 1

andrzejmontano/Qwen3.5-9B-MTP-Mixed-8bit

Image-Text-to-Text • Updated Jul 3 • 23

andrzejmontano/gemma-4-12B-it-Mixed-8bit

Image-Text-to-Text • Updated Jul 3 • 11

Alkd/TEA-ASR-1.1-MLX-4bit

Automatic Speech Recognition • 2B • Updated Jul 11 • 58 • 2

Avifenesh/Hy3-REAP-Layer103p5-bw24

Text Generation • Updated Jul 21 • 1

Baekpica/K-EXAONE-236B-A23B-Mixed-Quant-GGUF

Text Generation • 237B • Updated Aug 14 • 240 • 1

Baekpica/Motif-3-Mixed-Quant-GGUF

Text Generation • 315B • Updated Aug 30 • 358 • 4

faelfernandes/Qwen3.8-27B-3.5bit

27B • Updated Aug 14 • 126

Baekpica/dots3-note-prev-Mixed-Quant-GGUF

Text Generation • 281B • Updated Sep 6 • 194 • 3

soyaakinohara/gemma-4-31b-it-heretic-3.68bpw-14gb.gguf

Text Generation • 31B • Updated 23 days ago • 614 • 2

Etherealty/Huihui-Qwen3.5-4B-Abliterated-PMRA-GGUF

Text Generation • 4B • Updated Sep 4 • 102 • 1

Ayaz672i/Huihui-Qwen3.5-4B-Abliterated-PMRA-GGUF

Text Generation • 4B • Updated Sep 7 • 260 • 1

Baekpica/Inkling-Small-GGUF

Image-Text-to-Text • Updated 30 days ago • 349

Baekpica/Inkling-Small-Mixed-Quant-GGUF

Image-Text-to-Text • Updated 19 days ago • 1.87k • 2

Baekpica/IQuest-Q1-Mixed-Quant-GGUF

Text Generation • Updated 10 days ago • 985 • 2

kunthawat/swift-qwen3.8-27b-mixed-iq3-gguf

Image-Text-to-Text • 0.5B • Updated 7 days ago • 273

Plaguekind/Qwen3.8-27B-FrostDFlash-MixedLow-GGUF

Text Generation • 2B • Updated about 16 hours ago • 443