Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

34

Base only

Active filters: 70B

bartowski/Delta-Vector_Austral-70B-Winton-GGUF

Text Generation • 71B • Updated Jun 26, 2025 • 1.86k • 2

Darkknight535/Void-Citrus-L3.3-70B

Text Generation • 71B • Updated Feb 1 • 119 • • 12

Darkknight535/Void-Citrus-L3.3-70B-IQ3_XXS-GGUF

71B • Updated Feb 1 • 151 • 5

abideen/Liberated-Miqu-70B

Text Generation • Updated Mar 10, 2024 • 9 • 4

QueryloopAI/Liberated-Miqu-70B

Text Generation • Updated Mar 12, 2024 • 3

LoneStriker/Liberated-Miqu-70B-GGUF

69B • Updated Mar 12, 2024 • 48

LoneStriker/Liberated-Miqu-70B-2.4bpw-h6-exl2

Text Generation • Updated Mar 12, 2024 • 6

LoneStriker/Liberated-Miqu-70B-3.0bpw-h6-exl2

Text Generation • Updated Mar 12, 2024 • 5

LoneStriker/Liberated-Miqu-70B-4.0bpw-h6-exl2

Text Generation • Updated Mar 12, 2024 • 7 • 1

LoneStriker/Liberated-Miqu-70B-4.65bpw-h6-exl2

Text Generation • Updated Mar 12, 2024 • 7

LoneStriker/Liberated-Miqu-70B-5.0bpw-h6-exl2

Text Generation • Updated Mar 12, 2024 • 7

LoneStriker/Liberated-Miqu-70B-6.0bpw-h6-exl2

Text Generation • Updated Mar 12, 2024 • 9

LoneStriker/Liberated-Miqu-70B-2.65bpw-h6-exl2

Text Generation • Updated Mar 12, 2024 • 7

LoneStriker/Liberated-Miqu-70B-3.5bpw-h6-exl2

Text Generation • Updated Mar 12, 2024 • 8 • 1

mradermacher/Liberated-Miqu-70B-GGUF

69B • Updated Mar 29, 2025 • 353

mradermacher/Liberated-Miqu-70B-i1-GGUF

69B • Updated May 6, 2024 • 416

stepenZEN/DeepSeek-R1-Distill-Llama-70B-bitsandbytes-4bit

72B • Updated Jan 20, 2025 • 4

Delta-Vector/Austral-70B-Preview

Text Generation • 71B • Updated Jun 10, 2025 • 15 • • 3

lianghsun/Llama-3.1-DeepFox-70B-Instruct

Text Generation • Updated May 4

ArtusDev/Delta-Vector_Austral-70B-Preview-EXL3

Updated Jun 17, 2025 • 10

Delta-Vector/Austral-70B-Winton

Text Generation • 71B • Updated Jul 6, 2025 • 12 • • 6

ArtusDev/Delta-Vector_Austral-70B-Winton-EXL3

Updated Jun 26, 2025 • 13

mradermacher/Austral-70B-Preview-GGUF

71B • Updated Sep 2, 2025 • 170

mradermacher/Austral-70B-Preview-i1-GGUF

71B • Updated Dec 25, 2025 • 656

mradermacher/Austral-70B-Winton-GGUF

71B • Updated Sep 6, 2025 • 131

mradermacher/Austral-70B-Winton-i1-GGUF

71B • Updated Dec 28, 2025 • 813

Bloodviper/deepseek-llama3-ablit-slerp

Text Generation • 70B • Updated Jan 21 • 6 • 1

mradermacher/Athena-llamamerge-70B-GGUF

70B • Updated Jan 23 • 5

mradermacher/Athena-llamamerge-70B-i1-GGUF

70B • Updated Jan 23 • 153

mradermacher/Void-Citrus-L3.3-70B-GGUF

71B • Updated Feb 2 • 298 • 1