Models

mradermacher/sokol-1.5b-orpo-i1-GGUF

2B • Updated Jul 10 • 228

Kyleyee/Qwen2.5-1.5B-ropo-hh

Text Generation • 2B • Updated Jul 25 • 2

Eehan/Qwen2.5-1.5B-orpo-flip-hh

Text Generation • 2B • Updated Jul 28 • 4

Eehan/pythia-1b-orpo-flip-tldr

Text Generation • 1B • Updated Jul 28 • 3

Eehan/pythia-1b-orpo-tldr

Text Generation • 1B • Updated Jul 29 • 3

Dalfaxy/mt0_xl_french_detox_v3-beam-groups

Updated Aug 11

ShaunM1/pubmedqa-orpo-llama-3.1-8b

Text Generation • Updated Aug 13

alexxbobr/SFT5000stepsORPO5000steps

Text Generation • 0.5B • Updated Aug 13 • 5

alexxbobr/ORPO5000stepsclear

Text Generation • 0.5B • Updated Aug 13 • 5

alexxbobr/ORPO10000stepsclear

Text Generation • 0.5B • Updated Aug 14 • 2

ntraore/dbenv-week2-HW2-orpo

Text Generation • 0.1B • Updated Aug 14 • 3

neko-llm/Qwen3-32B-DPO-test

Text Generation • Updated Aug 16 • 7

manasvininid/exp-qwen3b-orpo

Text Generation • Updated Aug 16 • 18

miyako6105/Qwen3-32B-ORPO-test

Text Generation • 677k • Updated Aug 17 • 3

miyako6105/Qwen3-235B-ORPO-test

Updated Aug 24

TTahir/act-therapist-orpo-llama31-3b-2025-08-20

Text Generation • Updated Aug 20 • 16

ntkhoi/Qwen3-4B-Medical-SFT-ORPO-0820

Text Generation • 4B • Updated Aug 21 • 6

ntkhoi/Qwen3-4B-Medical-CPT-ORPO-0820

Text Generation • 4B • Updated Aug 21 • 4

TTahir/act-therapist-orpo-llama31-3b-2025-08-25

Text Generation • Updated Aug 25 • 1

mradermacher/Llama-3.1-8B-sft-gen-dpo-10k-ORPO-GGUF

8B • Updated Aug 30 • 109

mradermacher/Llama-3.1-8B-sft-SPIN-Llama-3.1-70B-Instruct-ORPO-GGUF

8B • Updated Sep 2 • 108 • 1

mradermacher/Llama-3.1-8B-sft-all-pool-ORPO-GGUF

8B • Updated Sep 3 • 174

splusminusx/SmolLM2-FT-ORPO

Text Generation • 0.1B • Updated Sep 5 • 4

AlekseyCalvin/Lyrical_LMT_ru2en_var2_Qwen3_4b-it_ft_5600steps_adapter

Updated Sep 6

AlekseyCalvin/Lyrical_MT_ru2en_var2b_Qwen3_4b-it_r256_6epochs_adapter

Translation • Updated Sep 6 • 3

AlekseyCalvin/Lyrical_MT_ru2en_var2a_DeepSeekR1_Qwen3_8b_adapter_Epoch1

Translation • Updated Sep 6 • 6

AlekseyCalvin/Lyrical_MT_ru2en_var2a_DeepSeekR1_Qwen3_8b_adapter_4ep

Translation • Updated Sep 6 • 3

AlekseyCalvin/Lyrical_MT_ru2en_2c_Gemma3n_e4b_orpo_r32_adapter

Translation • Updated Sep 24 • 5

AlekseyCalvin/Lyrical_MT_ru2en_2cb_Gemma3n_e4b_orpo_r16_adapter

Translation • Updated Sep 7 • 1

AlekseyCalvin/Lyrical_MT_rus2eng_2a2_DeepSeekR1Qwen3_8b_r64LoRA_PowerEMA_sigmaRel028

Translation • Updated Sep 7 • 1