Relayllm Efficient Reasoning Collaboration

Enable small language models to dynamically invoke larger models at critical reasoning tokens rather than offloading entire queries. RelayLLM achieves 49.52% accuracy across benchmarks while invoking the large model for only 1.07% of tokens—98.2% cost reduction compared to non-collaborative approaches.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit c7d1ff59be

Frequently asked questions

npx get-skill add adu2021/relayllm-efficient-reasoning-collaboration