Ultramemv2 Memory Networks

Scale memory networks to 120B parameters with improved long-context learning through integrated memory layers, simplified value projection, and optimized parameter ratios for superior memory-intensive tasks.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 7eca34d43b

Frequently asked questions

npx get-skill add adu2021/ultramemv2-memory-networks