zjunlp Fine-Tuning LR Sweep
Any fine-tune → always sweep LR over a wide range. Whether the plan hard-codes an LR, copies one from a paper, or leaves it open makes no difference: that value is one grid point, never the answer.
The only test of an LR is the criteria — the pass criteria in
task.md, or the claim criteria of the relevant experiment-plan milestone. Nothing else counts as acceptance evidence: a converged loss, a healthy grad norm, a rising reward, a "reasonable-looking" curve certify nothing. Criteria not met = LR not acceptable, no matter how good the training curves look.Criteria not met → change LR and re-run. Keep going until an LR passes. Only after the whole LR range has failed should you touch anything else.