Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

PostTrainingDynamic

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7

Base only

Active filters: PostTrainingDynamic

Intel/t5-small-xsum-int8-dynamic-inc

Updated Mar 21, 2024 • 1.35k • 1

Intel/roberta-base-mrpc-int8-dynamic-inc

Text Classification • Updated Dec 28, 2022 • 3

INC4AI/albert-base-v2-sst2-int8-dynamic-inc

Text Classification • Updated Jun 27, 2023 • 14

Intel/MiniLM-L12-H384-uncased-mrpc-int8-dynamic-inc

Text Classification • Updated Dec 28, 2022 • 2

INC4AI/gpt-j-6B-int8-dynamic-inc

Text Generation • Updated Apr 19, 2023 • 11 • 16

Intel/bert-large-uncased-rte-int8-dynamic-inc

Text Classification • Updated Mar 21, 2024 • 9

Intel/distilbert-base-uncased-MRPC-int8-dynamic-inc

Text Classification • Updated Mar 21, 2024 • 6 • 1