Results for “preferences”

Trains language models with Direct Preference Optimization using preference pairs, covering DPOTrainer setup, dataset preparation, and beta tuning for stable preference learning without explicit reward models.

Trains LLMs with SimPO, a reference-free preference optimization method that outperforms DPO, using configurable hyperparameters and workflows for various models and tasks.

Train language models with SimPO, a reference-free preference optimization method that outperforms DPO without needing a reference model.