Skip to content

[MoonEP] Add single-flight async event chaining - #35935

Draft
wirybeaver wants to merge 1 commit into
sgl-project:moonepfrom
wirybeaver:moonep-single-flight-async
Draft

wirybeaver wants to merge 1 commit into
sgl-project:moonepfrom
wirybeaver:moonep-single-flight-async

Conversation

@wirybeaver

@wirybeaver wirybeaver commented Aug 22, 2026

Copy link
Copy Markdown
Contributor

Summary

  • run MoonEP dispatch, BF16 weight prefetch, and combine on its communication stream, with GPU-side event waits at each compute consumer boundary
  • enforce process-wide single-flight dispatch → prefetch → combine ordering and poison uncertain queued failures
  • reject MoonEP with TBO/SBO and cover async, synchronous fallback, ordering, ownership, and validation behavior with CPU tests

Related PRs

Test plan

  • PYTHONPATH=python python -m pytest -q test/registered/unit/layers/moe/test_moonep_buffer.py test/registered/unit/server_args/test_server_args.py (158 passed, 17 subtests passed)
  • Black, isort, Ruff, git diff --check, and Python compilation
  • Multi-GPU NVSwitch BF16 synchronous/async parity validation

CI States

Latest PR Test (Base): ❌ Run #32540483710
Latest PR Test (Extra): ❌ Run #32540483551
Latest PR Test (AMD ROCm 10): ❌ Run #32540483763

Move MoonEP communication onto its async stream while preserving safe ordering and rejecting unsupported overlapping flights.
@Jiminator
Jiminator deleted the branch sgl-project:moonep September 14, 2026 04:42
@Jiminator Jiminator closed this Sep 14, 2026
@hnyls2002 hnyls2002 reopened this Sep 14, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants