Edit Models filters

Model Tree

meta-llama/Meta-Llama-3-70B-Instruct

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

48

Full-text search

Active filters: meta-llama/Meta-Llama-3-70B-Instruct

PawanKrd/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • 71B • Updated Apr 18, 2024 • 139 • 4

mlc-ai/Llama-3-70B-Instruct-q3f16_1-MLC

Updated Sep 7, 2025 • 40 • 1

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GPTQ

Text Generation • 71B • Updated Apr 19, 2024 • 701 • 19

QuantFactory/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • 71B • Updated Apr 20, 2024 • 499 • 46

lmstudio-community/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • 71B • Updated May 3, 2024 • 547 • 111

qwp4w3hyb/Meta-Llama-3-70B-Instruct-iMat-GGUF

Text Generation • 71B • Updated May 8, 2024 • 41 • 3

screevoai/llama3-70b-instruct-4bit

Text Generation • 73B • Updated Apr 23, 2024 • 5 • 1

LoneStriker/OpenBioLLM-Llama3-70B-GGUF

71B • Updated Apr 26, 2024 • 43 • 1

LoneStriker/OpenBioLLM-Llama3-70B-2.4bpw-h6-exl2

Text Generation • Updated Apr 27, 2024 • 1

LoneStriker/OpenBioLLM-Llama3-70B-3.5bpw-h6-exl2

Text Generation • Updated Apr 27, 2024

LoneStriker/OpenBioLLM-Llama3-70B-4.0bpw-h6-exl2

Text Generation • Updated Apr 27, 2024 • 1

LoneStriker/OpenBioLLM-Llama3-70B-4.65bpw-h6-exl2

Text Generation • Updated Apr 27, 2024

LoneStriker/OpenBioLLM-Llama3-70B-5.0bpw-h6-exl2

Text Generation • Updated Apr 27, 2024

LoneStriker/OpenBioLLM-Llama3-70B-6.0bpw-h6-exl2

Text Generation • Updated Apr 27, 2024

second-state/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • 71B • Updated May 6, 2024 • 174 • 4

LiteLLMs/Llama3-OpenBioLLM-70B-GGUF

71B • Updated May 28, 2024 • 211 • 7

lmstudio-community/Meta-Llama-3-70B-Instruct-BPE-fix-GGUF

Text Generation • 71B • Updated May 3, 2024 • 78 • 4

blockblockblock/Llama-3-70B-Instruct-DPO-v0.4-bpw2.25-exl2

Text Generation • Updated May 3, 2024

blockblockblock/Llama-3-70B-Instruct-DPO-v0.4-bpw2.5-exl2

Text Generation • Updated May 3, 2024 • 1

blockblockblock/Llama-3-70B-Instruct-DPO-v0.4-bpw3-exl2

Text Generation • Updated May 3, 2024 • 1

blockblockblock/Llama3-OpenBioLLM-70B-bpw4-exl2

Text Generation • Updated May 4, 2024 • 1

QuantFactory/Meta-Llama-3-70B-Instruct-GGUF-v2

Text Generation • 71B • Updated May 6, 2024 • 167 • 16

LiteLLMs/Meta-Llama-3-120B-Instruct-GGUF

Updated May 30, 2024 • 23 • 1

LoneStriker/Llama-3-70B-Instruct-DPO-v0.4-3.5bpw-h6-exl2

Text Generation • Updated May 6, 2024 • 2

LoneStriker/Llama-3-70B-Instruct-DPO-v0.4-2.4bpw-h6-exl2

Text Generation • Updated May 6, 2024 • 1

LoneStriker/Llama-3-70B-Instruct-DPO-v0.4-4.65bpw-h6-exl2

Text Generation • Updated May 6, 2024

LoneStriker/Llama-3-70B-Instruct-DPO-v0.4-4.0bpw-h6-exl2

Text Generation • Updated May 6, 2024 • 2

LoneStriker/Llama-3-70B-Instruct-DPO-v0.4-5.0bpw-h6-exl2

Text Generation • Updated May 6, 2024 • 2

LoneStriker/Llama-3-70B-Instruct-DPO-v0.4-6.0bpw-h6-exl2

Text Generation • Updated May 6, 2024 • 2

LoneStriker/Meta-Llama-3-120B-Instruct-2.65bpw-h6-exl2

Text Generation • Updated May 7, 2024 • 1