Mamba Architecture

State-space model with O(n) complexity vs Transformers' O(n²). 5× faster inference, million-token sequences, no KV cache. Selective SSM with hardware-aware design. Mamba-1 (d_state=16) and Mamba-2 (d_state=128, multi-head). Models 130M-2.8B on HuggingFace.

bishal-pdMSFT Updated 0 repo stars

File contents

bishal-pdMSFT/msb-skills commit 3c586a0d1c

Frequently asked questions

npx get-skill add bishal-pdmsft/mamba-architecture