Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

5,589

Full-text search

Active filters: quantized

MaziyarPanahi/gemma-3-4b-it-GGUF

Text Generation • 4B • Updated Mar 12, 2025 • 96k • 18

MaziyarPanahi/DeepSeek-R1-0528-Qwen3-8B-GGUF

Text Generation • 8B • Updated May 29, 2025 • 89.6k • 9

nvidia/DeepSeek-R1-0528-NVFP4-v2

Text Generation • 394B • Updated Sep 2, 2025 • 176k • 16

DevParker/VibeVoice7b-low-vram

Text-to-Speech • Updated Oct 23, 2025 • 62

nvidia/Phi-4-reasoning-plus-FP8

15B • Updated Sep 15, 2025 • 610 • 4

phazei/HunyuanVideo-Foley

Updated Oct 3, 2025 • 16

nvidia/Qwen3-8B-NVFP4

Text Generation • 5B • Updated Sep 9, 2025 • 33.6k • 15

vito95311/Qwen3-Omni-30B-A3B-Thinking-INT8FP16

Text Generation • 32B • Updated Sep 24, 2025 • 7 • 5

FabioSarracino/VibeVoice-Large-Q8

Text-to-Audio • 9B • Updated Oct 1, 2025 • 1.38k • 87

mlx-community/LFM2-8B-A1B-3bit-MLX

Text Generation • 1B • Updated Oct 8, 2025 • 83 • 2

aninokumar/Qwen3-8B-M2V-Entropy-RAG

Updated Nov 10, 2025 • 8 • 1

geoffmunn/Qwen3-30B-A3B-Thinking-2507

Text Generation • 31B • Updated Nov 13, 2025 • 210 • 2

logos-flux/Qwen3-4B-Instruct-2507-heretic-GGUF

4B • Updated Nov 22, 2025 • 239 • 1

TevunahAi/gpt-oss-120b-1024-Calibration-FP8

Text Generation • 117B • Updated Dec 8, 2025 • 45 • 1

nvidia/Qwen3-Next-80B-A3B-Instruct-NVFP4

Text Generation • Updated 30 days ago • 69.4k • 33

Ex0bit/Elbaz-NVIDIA-Nemotron-3-Nano-30B-A3B-PRISM-NVFP4

Text Generation • 16B • Updated Dec 18, 2025 • 35 • 3

unsloth/Qwen-Image-GGUF

Text-to-Image • 20B • Updated Dec 22, 2025 • 1.05k • 26

Ex0bit/GLM-4.7-PRISM

Text Generation • 353B • Updated Jan 5 • 962 • 29

unsloth/Qwen-Image-2512-FP8

Text-to-Image • Updated Jan 2 • 34

unsloth/Qwen-Image-2512-unsloth-bnb-4bit

Text-to-Image • Updated Jan 16 • 1.17k • 13

dam2452/Qwen3-VL-Embedding-8B-GGUF

8B • Updated Jan 11 • 1.79k • 4

marksverdhei/GLM-4.7-Flash-FP8

Text Generation • Updated Jan 31 • 91k • 19

cahlen/lingbot-world-base-cam-nf4

Image-to-Video • Updated Feb 3 • 15

kgrabko/JiRackTernary_70b

Text Generation • Updated about 5 hours ago • 162 • 1

bullpoint/Qwen3-Coder-Next-AWQ-4bit

Text Generation • 14B • Updated Feb 3 • 1.39M • 15

inferencerlabs/GLM-5-MLX-4.8bit

Text Generation • 744B • Updated 13 days ago • 7.17k • 10

RunPod/FLUX.2-klein-4B-mflux-4bit

Text-to-Image • Updated 22 days ago • 1

alphakek/GLM-4.7-Flash-heretic-NVFP4

Text Generation • 17B • Updated 21 days ago • 233 • 1

manu02/kani-tts-2-pt-bnb-4bit-nf4-dq

Text Generation • 0.4B • Updated 22 days ago • 9 • 1

EliasOenal/MiniMax-M2.5-Hybrid-AWQ-W4A16G128-Attn-fp8_e4m3-KV-fp8_e4m3

Text Generation • 34B • Updated 21 days ago • 542 • 12