YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

GPTQ quantisation of https://huggingface.co/ai-forever/ruGPT-3.5-13B

Small perplexity test: before quantization - 'mean_perplexity': 10.241 after quantization - 'mean_perplexity': 10.379

Data - RussianSuperGlue > DaNetQA/train.jsonl['passage']

As this is a hastily thrown together quant with no prior experience in quants, use https://huggingface.co/TheBloke version if he releases a quant for this model.

Downloads last month
14
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support