Beyond Real Imaginary Rope

Improve long-context performance by incorporating imaginary components discarded in standard RoPE implementations. Use phase information from complex-valued attention for richer positional encoding—especially valuable as context length increases beyond normal ranges.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit d2830bbade

Frequently asked questions

npx get-skill add adu2021/beyond-real-imaginary-rope