Skip to content

feat: Ring Attention + KV Cache compression for 1M context on consumer hardware - #76

Open
oyi77 wants to merge 5 commits into
kyegomez:mainfrom
oyi77:feature/ring-attention
Open

feat: Ring Attention + KV Cache compression for 1M context on consumer hardware#76
oyi77 wants to merge 5 commits into
kyegomez:mainfrom
oyi77:feature/ring-attention

feat: Add Ring Attention + KV Cache compression for 1M context

0aa78de
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs