Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

176

Full-text search

Active filters: edge-ai

mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-i1-GGUF

Text Generation • 0.1B • Updated Dec 21, 2025 • 327

mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b16-3060-v2-finetuned-GGUF

Text Generation • 0.1B • Updated Jul 31, 2025 • 24

mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b16-3060-v2-finetuned-i1-GGUF

Text Generation • 0.1B • Updated Dec 25, 2025 • 116

kshitijthakkar/loggenix-moe-0.3B-A0.1B-e3-lr7e5-b16-4090-v5.1-finetuned

Text Generation • 0.3B • Updated Aug 4, 2025 • 30 • 2

JahnaviBhansali/person-classification-tflite

Image Classification • Updated Aug 1, 2025 • 146 • 1

mradermacher/loggenix-moe-0.3B-A0.1B-e3-lr7e5-b16-4090-v5.1-finetuned-GGUF

Text Generation • 0.3B • Updated Aug 1, 2025 • 92 • 2

magicunicorn/whisper-large-v3-amd-npu-int8

Updated Aug 30, 2025 • 17 • 3

magicunicorn/whisper-large-v2-amd-npu-int8

Updated Aug 30, 2025 • 13 • 4

magicunicorn/whisper-medium-amd-npu-int8

Updated Aug 30, 2025 • 2

magicunicorn/whisper-small-amd-npu-int8

Updated Aug 30, 2025 • 5 • 1

magicunicorn/whisper-base-amd-npu-int8

Updated Aug 30, 2025 • 1

jamescallander/deepseek-llm-7b-chat_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 5, 2025 • 10

jamescallander/txgemma-9b-chat_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 5, 2025 • 15

jamescallander/NextCoder-7B_w8a8_g128_rk3588.rkllm

Text Generation • Updated Oct 27, 2025 • 15 • 1

jamescallander/Qwen2.5-Math-1.5B-Instruct_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 5, 2025 • 12

jamescallander/MediPhi-Instruct_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 6, 2025 • 6

jamescallander/Qwen2.5-Coder-3B-Instruct_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 5, 2025 • 16 • 1

jamescallander/Llama-3.1-8B-Instruct_w8a8_g128_rk3588.rkllm

Text Generation • Updated Oct 9, 2025 • 31

jamescallander/MiniCPM4-0.5B_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 5, 2025 • 16

jamescallander/TinyLlama-1.1B-Chat-v1.0_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 5, 2025 • 29 • 1

jamescallander/MediPhi-PubMed_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 5, 2025 • 7

jamescallander/medgemma-4b-it_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 6, 2025 • 11

jamescallander/Qwen2.5-Math-7B-Instruct_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 6, 2025 • 6

jamescallander/deepseek-coder-1.3b-instruct_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 19, 2025 • 12

jamescallander/MiniCPM3-4B_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 8, 2025 • 6

jamescallander/Llama-3.2-3B-Instruct_w8a8_g128_rk3588.rkllm

Text Generation • Updated Oct 9, 2025 • 30

cluangar/typhoon2-qwen2.5-7B-rk3588

Text Generation • Updated Sep 18, 2025 • 4

jamescallander/DeepSeek-R1-Distill-Qwen-14B_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 20, 2025 • 12

jamescallander/deepseek-coder-6.7b-instruct_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 21, 2025 • 7

jamescallander/CodeLlama-7b-Instruct-hf_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 20, 2025 • 9