Models

928

Full-text search

Active filters: orpo, trl

alexxbobr/ORPO15000gptdata

Text Generation • 0.5B • Updated Jan 19 • 3

alexxbobr/ORPO8000

Text Generation • 0.5B • Updated Jan 20 • 3

alexxbobr/ORPO8000plus5000

Text Generation • 0.5B • Updated Jan 21 • 2

iam-ishn/gemma-3-4b-orpo

iam-ishn/malayalam-gemma-3-4b-it-sft-orpo

Text Generation • 4B • Updated Feb 6

visity/llama-3-instruct-8b-orpo-full

Text Generation • 8B • Updated Feb 6 • 6

vivekmarakana/shunya-0.5b-instruct

Text Generation • 0.5B • Updated Feb 22 • 5

weights-and-wires/Llama-3.2-3B-Polite-ORPO

ogidogg/run_6

zzzzineun/medgemma_oph_orpo_adapter

Text Generation • Updated Mar 12

alexxbobr/ORPO8000Vikhr-Llama-3.2-1B-Instruct

Text Generation • 1B • Updated Mar 20 • 13

SuperPuperD/yurteg-1.5b-v3-lora

Text Generation • Updated Mar 22 • 9

nyxspecter4/kin-orpo-lora

llm-model-lab/gemma3-27b-orpo-thinking-v2

Updated 28 days ago • 29

llm-model-lab/gemma3-27b-orpo-thinking-v2-checkpoint-571

Updated 28 days ago • 33

llm-model-lab/gemma3-27b-orpo-thinking-v2-checkpoint-1142

Updated 28 days ago • 32

llm-model-lab/gemma3-27b-orpo-thinking-v2-checkpoint-1712

Updated Mar 30 • 16

ArthT/SmolLM3-3B-ORPO

Text Generation • Updated 24 days ago • 15

Priyangshu-2003/MediBridge-II-Medical-8B-FineTuned

Text Generation • Updated 21 days ago • 34

amphora/orpo-lr-2e4

Updated 18 days ago

yongjer/HY-MT1.5-1.8B-Trad-Chinese-ORPO

Translation • Updated 15 days ago

alexxbobr/ORPO8000Vikhr-Llama-3.2-1B-Instruct5000

Text Generation • 1B • Updated 8 days ago • 216

alexxbobr/ORPO8000Vikhr-Llama-3.2-1B-Instruct30002000

Text Generation • 1B • Updated 6 days ago • 198

Kyleyee/ORPO_hh-seed5

Text Generation • 2B • Updated 3 days ago • 202

Kyleyee/ORPO_hh-seed2

Text Generation • 2B • Updated 3 days ago • 199

Kyleyee/ORPO_hh-seed4

Text Generation • 2B • Updated 3 days ago • 189

Kyleyee/ORPO_hh-seed3

Text Generation • 2B • Updated 3 days ago • 203

versperai/Versper-V1-Evo-ckpts

Updated about 11 hours ago