inference-optimization/NVIDIA-Nemotron-3-Nano-30B-A3B-quantized.w4a16
6B
•
Updated
Inference Optimization
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
inference-optimization/NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4
18B
•
Updated
•
9
inference-optimization/NVIDIA-Nemotron-3-Nano-30B-A3B-FP8-dynamic
32B
•
Updated
•
52
inference-optimization/Qwen3-Next-80B-A3B-Thinking-FP8-block
Text Generation
•
80B
•
Updated
•
50
inference-optimization/Qwen3-Next-80B-A3B-Instruct-FP8-block
Text Generation
•
80B
•
Updated
•
91
inference-optimization/Qwen3-Next-80B-A3B-Instruct-quantized.w4a16
Updated
•
54
inference-optimization/Qwen3-Next-80B-A3B-Instruct-FP8-dynamic
Text Generation
•
80B
•
Updated
•
90
inference-optimization/Qwen3-Next-80B-A3B-Thinking-NVFP4
Text Generation
•
Updated
•
30
inference-optimization/Qwen3-Next-80B-A3B-Instruct-NVFP4
Text Generation
•
Updated
•
32
inference-optimization/Qwen3-Next-80B-A3B-Thinking-FP8-dynamic
Text Generation
•
80B
•
Updated
•
75
inference-optimization/Qwen3-Next-80B-A3B-Thinking-quantized.w4a16
Updated
•
50
inference-optimization/Qwen3-Next-80B-A3B-Thinking-quantized.w8a8
Updated
inference-optimization/NVIDIA-Nemotron-3-Nano-30B-A3B-FP8-block
Updated
inference-optimization/GLM-4.6-quantized.w8a8
353B
•
Updated
•
96
inference-optimization/GLM-4.6-quantized.w4a16
48B
•
Updated
•
154
inference-optimization/Qwen3-30B-A3B-Thinking-2507.w4a16
Text Generation
•
5B
•
Updated
•
19
inference-optimization/Qwen3-30B-A3B-Instruct-2507.w4a16
Text Generation
•
5B
•
Updated
•
36
inference-optimization/Qwen3-4B-Instruct-2507.w4a16
Text Generation
•
1B
•
Updated
•
72
inference-optimization/Qwen3-4B-Thinking-2507.w4a16
Text Generation
•
1B
•
Updated
•
337
inference-optimization/GLM-4.6-FP8-dynamic
353B
•
Updated
•
73
inference-optimization/Llama-3.1-8B-Instruct-FP8-dynamic-QKV-Cache-FP8-Per-Head
8B
•
Updated
•
23
inference-optimization/Llama-3.1-8B-Instruct-QKV-Cache-FP8-Per-Head
8B
•
Updated
•
37
inference-optimization/Qwen3-Next-80B-A3B-Instruct-quantized.w8a8
Updated
inference-optimization/Llama-3.1-8B-Instruct-HIGGS-quantized-paths
Updated
inference-optimization/Llama-3.1-8B-Instruct-Mixed-NVFP4-FP8_DYNAMIC-gate_up_proj-all
7B
•
Updated
•
2
inference-optimization/Llama-3.1-8B-Instruct-Mixed-NVFP4-FP8_DYNAMIC-down_proj-all
6B
•
Updated
•
2
inference-optimization/Llama-3.1-8B-Instruct-Mixed-NVFP4-FP8_DYNAMIC-qkv_proj-all
5B
•
Updated
•
20
inference-optimization/Llama-3.1-8B-Instruct-Mixed-NVFP4-FP8_DYNAMIC-out_proj-all
5B
•
Updated
•
2
inference-optimization/Llama-3.1-8B-Instruct-Mixed-NVFP4-FP8_BLOCK-gate_up_proj-all
7B
•
Updated
•
2
inference-optimization/Llama-3.1-8B-Instruct-Mixed-NVFP4-FP8_BLOCK-down_proj-all
6B
•
Updated
•
2