Implement ring attention (arXiv:2310.01889)#450

Draft

Copilot wants to merge 7 commits intomainfrom

copilot/implement-ring-attention

Commits on Mar 12, 2026

Commits on Mar 13, 2026

Add strong/weak scaling benchmark (1-8 GPUs) and update results figure

Copilot
and
mawad-amd
committed