Models

11,946

Full-text search

Active filters: dpo

sweepai/sweep-next-edit-v2-7B

Text Generation • 8B • Updated about 1 month ago • 377 • 22

F16/z-image-turbo-flow-dpo

Feature Extraction • Updated 21 days ago • 173

danielcherubini/Qwen3.5-DeltaCoder-9B-GGUF

Text Generation • 9B • Updated 29 days ago • 6.6k • 14

BugTraceAI/BugTraceAI-Apex-G4-26B-Q4

25B • Updated 15 days ago • 17.7k • 57

mlabonne/NeuralDaredevil-8B-abliterated

Text Generation • 8B • Updated Jan 23 • 16.2k • • 269

QuantFactory/NeuralDaredevil-8B-abliterated-GGUF

Text Generation • 8B • Updated May 29, 2024 • 4.55k • 90

v000000/Qwen2.5-14B-Gutenberg-Instruct-Slerpeno

Text Generation • 15B • Updated Sep 30, 2024 • 102 • • 7

daiheng/MolFORM

Reinforcement Learning • Updated Mar 13 • 2

mradermacher/G-Health-14B-Base-i1-GGUF

15B • Updated Mar 14 • 150 • 2

ToastyPigeon/Qwen3.5-27B-Heretic-Marvin-V1

27B • Updated Mar 21 • 16 • 2

dennisonb/qwen25-tax-3b

Reinforcement Learning • 3B • Updated Mar 27 • 14 • 1

ArmadaOS/AOS-Shadow-v1.0

Text Generation • 10B • Updated Mar 27 • 52 • 1

ArmadaOS/AOS-Chief-of-Staff-v1.0

Text Generation • 10B • Updated Mar 27 • 54 • 1

VladShash/deepseek-math-7b-lean-prover-dpo-olmo-3

Text Generation • 7B • Updated 17 days ago • 3.22k • 4

ReXeeD/Luminus-1.5B-Roleplay

Text Generation • 2B • Updated about 16 hours ago • 479 • 1

ReXeeD/Luminus-1.5B-Roleplay-GGUF

Text Generation • 2B • Updated about 16 hours ago • 1.82k • 1

TinmanLabSL/gemma3-4b-companion

Text Generation • Updated 8 days ago • 1

Olak17/Qwen2.5-Coder-1.5B-Unsensored-DPO-i1-GGUF

2B • Updated 20 days ago • 3.32k • 2

zipaltrivedi/dotnet-coder-14b

Text Generation • 15B • Updated 11 days ago • 3.81k • 4

F16/z-image-turbo-masked-dpo

Text-to-Image • Updated 21 days ago • • 17

lyogavin/Anima33B-DPO-Belle-1k

Text Generation • Updated Jul 2, 2023 • 1

lyogavin/Anima33B-DPO-Belle-1k-merged

Text Generation • Updated Jul 2, 2023 • 9 • 12

daekeun-ml/Llama-2-ko-DPO-13B

Text Generation • 13B • Updated Oct 31, 2023 • 6 • 19

lewtun/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 5, 2024 • 6

alignment-handbook/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 10, 2024 • 18 • 3

alignment-handbook/zephyr-7b-dpo-qlora

Updated Jan 9, 2024 • 18 • 9

argilla/notus-7b-v1-lora

Text Generation • Updated Dec 4, 2023 • 13 • 7

argilla/notus-7b-v1-lora-adapter

Text Generation • Updated Dec 4, 2023 • 3

argilla/notus-7b-v1

Text Generation • 7B • Updated Dec 5, 2023 • 99 • 123

ContextualAI/archangel_sft_pythia1-4b

Text Generation • 1B • Updated Jan 11, 2024 • 8