Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

32

Base only

Active filters: optiq

mlx-community/gemma-4-12B-it-OptiQ-4bit

Text Generation • 12B • Updated 3 days ago • 3.76k • 9

mlx-community/MiniCPM5-1B-OptiQ-4bit

Text Generation • 0.2B • Updated 9 days ago • 951 • 6

mlx-community/Qwen3.5-9B-OptiQ-4bit

Text Generation • 9B • Updated 2 days ago • 119k • 55

mlx-community/Qwen3.6-35B-A3B-OptiQ-4bit

Text Generation • 35B • Updated 2 days ago • 9.85k • 17

mlx-community/gemma-4-e4b-it-OptiQ-4bit

Text Generation • 7B • Updated 3 days ago • 11.8k • 26

mlx-community/Qwen3.6-27B-OptiQ-4bit

Text Generation • 27B • Updated 2 days ago • 15.5k • 28

mlx-community/gemma-4-26B-A4B-it-OptiQ-4bit

Text Generation • 25B • Updated 3 days ago • 5.24k • 8

sahilchachra/mellum2-12b-a2_5b-thinking-optiq-5bpw-mlx

12B • Updated 6 days ago • 414 • 3

mlx-community/Qwen3.5-4B-OptiQ-4bit

Text Generation • 0.9B • Updated 2 days ago • 6.25k • 17

osmapi/Step-3.7-Flash-OptiQ-3.7bpw-mlx

Image-Text-to-Text • 30B • Updated 8 days ago • 1.03k • 3

mlx-community/Qwen3.5-2B-OptiQ-4bit

Text Generation • 0.4B • Updated 2 days ago • 3.15k • 9

osmapi/osmQwopus-3.6-27B-V2-heretic-abliterated-uncensored-OptiQ-3.7bpw-mlx

Image-Text-to-Text • 27B • Updated 8 days ago • 1.19k • 3

sahilchachra/lfm2-5-8b-a1b-optiq-5bpw-mlx

8B • Updated 12 days ago • 120 • 2

mlx-community/Qwen3.5-0.8B-OptiQ-4bit

Text Generation • 0.2B • Updated 2 days ago • 3.91k • 19

machinadeusex/Qwen3.5-4B-OptiQ-4bit

Text Generation • 0.8B • Updated Mar 14 • 96 • 1

mlx-community/YOLO26n-OptiQ-6bit

Object Detection • Updated Apr 26 • 57

mlx-community/YOLO26s-OptiQ-6bit

Object Detection • Updated Apr 26 • 43

mlx-community/YOLO26m-OptiQ-6bit

Object Detection • Updated Apr 26 • 56

mlx-community/YOLO26x-OptiQ-6bit

Object Detection • Updated Apr 26 • 162 • 2

mlx-community/YOLO26l-OptiQ-6bit

Object Detection • Updated Apr 26 • 57

mlx-community/gemma-4-e2b-it-OptiQ-4bit

Text Generation • 1B • Updated 3 days ago • 2.74k • 3

mlx-community/Qwen3.5-27B-OptiQ-4bit

Text Generation • 27B • Updated 2 days ago • 1.13k • 2

mlx-community/Qwen3.5-35B-A3B-OptiQ-4bit

Text Generation • 35B • Updated 2 days ago • 1.8k • 2

mlx-community/gemma-4-31B-it-OptiQ-4bit

Text Generation • 31B • Updated 3 days ago • 5.8k • 5

Meguriai/Qwen3.6-27B-OptiQ-4bit

Text Generation • 27B • Updated 15 days ago • 230

sahilchachra/minicpm5-1b-optiq-5bpw-mlx

0.2B • Updated 14 days ago • 218

dawncr0w/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-OptiQ-4bit-MLX

Text Generation • 35B • Updated 11 days ago • 939

dawncr0w/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-OptiQ-5bpw-MLX

Text Generation • 35B • Updated 11 days ago • 720

dawncr0w/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-OptiQ-6bpw-MLX

Text Generation • 35B • Updated 11 days ago • 1.43k

mlx-community/NVIDIA-Nemotron-3-Nano-4B-OptiQ-4bit

Text Generation • 0.8B • Updated 6 days ago • 296