Phi-3-mini-128k-instruct - bnb 4bit

Description

This model is 4bit quantized version of Phi-3-mini-128k-instruct using bitsandbytes. It's designed for fine-tuning! The PAD token is set as "<|endoftext|>".

Downloads last month
14
Safetensors
Model size
2B params
Tensor type
F32
路
BF16
路
U8
路
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support

Model tree for slacktoid/Phi-3-mini-128k-instruct-bnb-4bit

Quantized
(87)
this model