SkillMD SkillMD
light-dark-mode
Profile My skills Saved Collections Preferences Submit a skill

Results for “preference-optimization”

4 skills
majiayu000
dpo
Trains language models with Direct Preference Optimization using preference pairs, covering DPOTrainer setup, dataset preparation, and beta tuning for stable preference learning without explicit reward models.
567 · bundle
More results
orchestra-research
simpo-training
Train language models with SimPO, a reference-free preference optimization method that outperforms DPO without needing a reference model.
10.4k · bundle
qhjqhj00
pymoo
Solve single- and multi-objective optimization problems with NSGA-II/III, MOEA/D, and other evolutionary algorithms, including Pareto front analysis, constraint handling, and benchmarking on standard test problems.
3 · bundle
lord1egypt
simpo-training
Trains LLMs with SimPO, a reference-free preference optimization method that outperforms DPO, using configurable hyperparameters and workflows for various models and tasks.
2