-
inference-optimization/Qwen3-8B-DFlash-Gauss-FP8-W8A8
Text Generation • 1B • Updated • 39 -
inference-optimization/Qwen3-8B-DFlash-PerfectBlend-FP8-W8A8
Text Generation • 1B • Updated • 37 -
inference-optimization/Qwen3-8B-DFlash-Gauss-NVFP4-W4A4
Text Generation • 1B • Updated • 129 -
inference-optimization/Qwen3-8B-DFlash-PerfectBlend-NVFP4-W4A4
Text Generation • 1B • Updated • 124
Inference Optimization
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
Tiny models used for testing
-
inference-optimization/gemma-4-1B-0.8B-tiny
1B • Updated • 1.52k • 2 -
inference-optimization/DSV4-tiny-empty
3B • Updated • 4.16k • 1 -
inference-optimization/Qwen3-1.6B-A0.9B
Text Generation • 2B • Updated • 12.5k • 3 -
inference-optimization/Llama-3.2-0.5B-Instruct
Text Generation • 0.5B • Updated • 17k • 1
Models used in CI tests across llm-compressor, compressed-tensors, and vllm repositories.
-
inference-optimization/DSV4-tiny-empty
3B • Updated • 4.16k • 1 -
inference-optimization/GLM-5.2-0.8B-A0.8B
Text Generation • 0.8B • Updated • 4.26k • 4 -
inference-optimization/Llama-3.2-0.5B-Instruct
Text Generation • 0.5B • Updated • 17k • 1 -
inference-optimization/Qwen3-1.6B-A0.9B
Text Generation • 2B • Updated • 12.5k • 3
Toy-trained BF16/FP8 fixtures for PR #3225 on Transformers 5.17. Model cards document DSA and Inkling limitations.
-
inference-optimization/GLM-4.5-Air-0.72B-MTP
Text Generation • 0.7B • Updated • 13 -
inference-optimization/GLM-4.5-Air-0.72B-MTP-FP8-Dynamic
Text Generation • 0.7B • Updated • 12 -
inference-optimization/GLM-4.7-Flash-0.82B-MTP
Text Generation • 0.8B • Updated • 12 -
inference-optimization/GLM-4.7-Flash-0.82B-MTP-FP8-Dynamic
Text Generation • 0.8B • Updated • 9
-
inference-optimization/Qwen3-8B-DFlash-Gauss-FP8-W8A8
Text Generation • 1B • Updated • 39 -
inference-optimization/Qwen3-8B-DFlash-PerfectBlend-FP8-W8A8
Text Generation • 1B • Updated • 37 -
inference-optimization/Qwen3-8B-DFlash-Gauss-NVFP4-W4A4
Text Generation • 1B • Updated • 129 -
inference-optimization/Qwen3-8B-DFlash-PerfectBlend-NVFP4-W4A4
Text Generation • 1B • Updated • 124
Models used in CI tests across llm-compressor, compressed-tensors, and vllm repositories.
-
inference-optimization/DSV4-tiny-empty
3B • Updated • 4.16k • 1 -
inference-optimization/GLM-5.2-0.8B-A0.8B
Text Generation • 0.8B • Updated • 4.26k • 4 -
inference-optimization/Llama-3.2-0.5B-Instruct
Text Generation • 0.5B • Updated • 17k • 1 -
inference-optimization/Qwen3-1.6B-A0.9B
Text Generation • 2B • Updated • 12.5k • 3
Tiny models used for testing
-
inference-optimization/gemma-4-1B-0.8B-tiny
1B • Updated • 1.52k • 2 -
inference-optimization/DSV4-tiny-empty
3B • Updated • 4.16k • 1 -
inference-optimization/Qwen3-1.6B-A0.9B
Text Generation • 2B • Updated • 12.5k • 3 -
inference-optimization/Llama-3.2-0.5B-Instruct
Text Generation • 0.5B • Updated • 17k • 1
Toy-trained BF16/FP8 fixtures for PR #3225 on Transformers 5.17. Model cards document DSA and Inkling limitations.
-
inference-optimization/GLM-4.5-Air-0.72B-MTP
Text Generation • 0.7B • Updated • 13 -
inference-optimization/GLM-4.5-Air-0.72B-MTP-FP8-Dynamic
Text Generation • 0.7B • Updated • 12 -
inference-optimization/GLM-4.7-Flash-0.82B-MTP
Text Generation • 0.8B • Updated • 12 -
inference-optimization/GLM-4.7-Flash-0.82B-MTP-FP8-Dynamic
Text Generation • 0.8B • Updated • 9