Long Context Rope Scaling Eval

Extend context windows of transformer models using RoPE, YaRN, ALiBi, and position interpolation techniques. Use when processing long documents (32k-128k+ tokens), extending pre-trained models beyond original context limits, or implementing efficient positional encodings. Covers rotary embeddings, attention biases, interpolation methods, and extrapolation strategies for LLMs.

robertoatila Updated 9 repo stars
J.A.R.V.I.S. — Autonomous Cognitive Runtime

File contents

robertoatila/jarvis-skill-registry commit 5c2e4e73e6

Frequently asked questions

npx get-skill add robertoatila/long-context-rope-scaling-eval-2