Results for “long-form-content”
3 skills
orchestra-research long-context
Extend context windows of transformer models using RoPE, YaRN, ALiBi, and position interpolation techniques for processing long documents and implementing efficient positional encodings.
10.4k · bundle
tianhao909 long-context
Extend context windows of transformer models using RoPE, YaRN, ALiBi, and position interpolation techniques. Use when processing long documents (32k-128k+ tokens), extending pre-trained models beyond original context limits, or implementing efficient positional encodings. Covers rotary embeddings, attention biases, interpolation methods, and extrapolation strategies for LLMs.
1 · bundle
qcmuu long-context
Extend context windows of transformer models using RoPE, YaRN, ALiBi, and position interpolation techniques. Use when processing long documents (32k-128k+ tokens), extending pre-trained models beyond original context limits, or implementing efficient positional encodings. Covers rotary embeddings, attention biases, interpolation methods, and extrapolation strategies for LLMs.
0 · bundle