Skip to content

Support empty varlen batches - #1

Closed
0z5a wants to merge 1 commit into
codex/kernel2-tile-prefixfrom
codex/zero-length-varlen
Closed

0z5a wants to merge 1 commit into
codex/kernel2-tile-prefixfrom
codex/zero-length-varlen

Conversation

@0z5a

@0z5a 0z5a commented Aug 17, 2026

Copy link
Copy Markdown
Owner

Summary

  • Define zero-length sequence semantics for cu_seqlens with repeated offsets.
  • Avoid constructing invalid zero-extent TMA descriptors for all-empty batches.
  • Preserve initial_state in final_state, or write zeros when no initial state is supplied.

Validation

  • RTX 5080 (SM120): python -m pytest tests/test_empty_varlen.py -vv — 32 passed.
  • Before this change, mixed-empty batches passed but all-empty batches aborted in the C++ extension.

Stacked on MoonshotAI#29; update the base after MoonshotAI#29 merges.

@0z5a 0z5a changed the title Support-empty-varlen-batches Support empty varlen batches Aug 17, 2026
@0z5a 0z5a closed this Aug 17, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants