Dr LLM Dynamic Routing

Use per-layer routers trained with Monte Carlo Tree Search to dynamically skip, execute, or repeat transformer layers for each token. Saves ~5 layers per example while maintaining accuracy on diverse benchmarks.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 56e292135a

Frequently asked questions

npx get-skill add adu2021/dr-llm-dynamic-routing