ricostaedeli
/

Meta-Llama-3.1-8B-Instruct_SFT_DPO

Text Generation

text-generation-inference

Model card Files Files and versions

Uploaded model

Developed by: ricostaedeli
License: apache-2.0
Finetuned from model : ricostaedeli/Meta-Llama-3.1-1B-Instruct_SFT_2

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month: 6

Safetensors

Model size

8B params

Tensor type

BF16

·

Model tree for ricostaedeli/Meta-Llama-3.1-8B-Instruct_SFT_DPO

Base model

ricostaedeli/Meta-Llama-3.1-8B-Instruct_SFT

Finetuned

(2)

this model