Skip to content
Schemory
Skill

emerging-techniques-long-context

Extend context windows of transformer models using RoPE, YaRN, ALiBi, and position interpolation techniques. Use when processing long documents (32k-128k+ tokens), extending pre-trained models beyond original context limits, or implementing efficient positional encodings. Covers rotary embeddings, attention biases, interpolation methods, and extrapolation strategies for LLMs.

Listed from its GitHub repository. Reports from people who tried it will appear here.

Source
davila7/claude-code-templates
GitHub stars
34,066
License
MIT

No reports yet

Nobody has written down how emerging-techniques-long-context works with their agent. Tried it? Say whether it worked, and with which agent and model.

Write the first report