gated-delta-rule

Here is 1 public repository matching this topic...

From-scratch SM80 (A100/A800) CUDA kernels for GDN (Gated DeltaNet) and QSA (query-key sparse attention). Apache-2.0.

gdn ampere qsa a100 linear-attention cuda-kernel sparse-attention llm-inference sm80 gated-delta-rule

To associate your repository with the gated-delta-rule topic, visit your repo's landing page and select "manage topics."