Finetuning

Use when adapting an open-weight model to a target form or behavior — tone, output format, reasoning pattern — via LoRA/QLoRA or full fine-tuning with TRL SFTTrainer, then preference optimization (DPO/ORPO/KTO/GRPO), and for fine-tune vs prompt vs RAG. NOT adding facts to a model (that is rag); NOT the single-GPU Unsloth backend or GGUF export (that is unsloth).

ericrisco Updated 610 repo stars
rsc-harness: you build the product, rsc-harness builds your agent's harness, following strict best practices instead of improvising one.

File contents

ericrisco/rsc-harness commit c6d4e4be94

Frequently asked questions

npx get-skill add ericrisco/finetuning