Relay Gen Model Switching

Reduce inference cost by dynamically switching from large to small LLMs during reasoning generation. Large model handles demanding reasoning phases; small model completes consolidation and answer stages triggered by discourse cues. Achieves 2.2× speedup with minimal accuracy loss.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit a307d1d9c6

Frequently asked questions

npx get-skill add adu2021/relay-gen-model-switching