Neural Thickets Dense Task Experts

Discover that large pretrained models have dense neighborhoods of task-specific experts—random weight perturbations improve performance. Use RandOpt: sample perturbations, select top performers, ensemble via voting for multi-task adaptation.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 21797a3404

Frequently asked questions

npx get-skill add adu2021/neural-thickets-dense-task-experts