Learning Rate Matters Vanilla

Configure optimal learning rates for LoRA fine-tuning of LLMs. Generates hyperparameter search configs, training scripts, and analysis code that ensure vanilla LoRA matches or beats fancy variants. Triggers: 'fine-tune with LoRA', 'set up LoRA training', 'compare LoRA variants', 'optimize LoRA hyperparameters', 'learning rate sweep for LoRA', 'LoRA fine-tuning config'

ndpvt-web Updated 14 repo stars

File contents

ndpvt-web/arxiv-claude-skills commit ddd900c339

Frequently asked questions

npx get-skill add ndpvt-web/learning-rate-matters-vanilla