Paced Weighted Distillation

Weight distillation loss by student pass rate using Beta kernel: suppress mastered (high pass rate) and intractable (low pass rate) problems, prioritize intermediate zone where learning signal is richest.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 07f9ba9d77

Frequently asked questions

npx get-skill add adu2021/paced-weighted-distillation