Nemotron Nano Hybrid Mamba Transformer

Build hybrid Mamba-Transformer models combining efficient Mamba-2 layers with standard attention to achieve 6x higher inference throughput while maintaining reasoning accuracy on long-context tasks.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit a609dc7c07

Frequently asked questions

npx get-skill add adu2021/nemotron-nano-hybrid-mamba-transformer