Skip to content

[Klaud Cold] Update qwen3.5-fp4-b300-sglang (+mtp) SGLang image to v0.5.12-cu130#1475

Merged
functionstackx merged 4 commits into
mainfrom
update-qwen3.5-fp4-b300-sglang-v0.5.12
May 20, 2026
Merged

[Klaud Cold] Update qwen3.5-fp4-b300-sglang (+mtp) SGLang image to v0.5.12-cu130#1475
functionstackx merged 4 commits into
mainfrom
update-qwen3.5-fp4-b300-sglang-v0.5.12

Conversation

@functionstackx
Copy link
Copy Markdown
Collaborator

Summary

Update SGLang image from v0.5.11-cu130 (5d old) to v0.5.12-cu130

Recipes touched: `qwen3.5-fp4-b300-sglang`, qwen3.5-fp4-b300-sglang-mtp

Test plan

  • full-sweep-enabled sweep passes.

🤖 Generated with Claude Code

@github-actions
Copy link
Copy Markdown
Contributor

Thanks for the contribution! For vLLM & SGLang, please ensure that your recipes is similar to the official vLLM recipes and/or the SGLang cookbook

If it is not, please create a PR first before we can merge your single node PR into the master branch. Let's ensure that the documentation is first class such that the entire ML community can benefit from your hard work! Thank you

PR authors are responsible for ensuring that after merging, all GitHub Action jobs fully pass. A lot of the time, failures are just flakes and simply re-running the failed jobs will fix it. If re-running failed jobs is attempted, PR authors are responsible for ensuring it passes. See GitHub's docs on re-running failed jobs: https://docs.github.com/en/actions/how-tos/manage-workflow-runs/re-run-workflows-and-jobs#re-running-failed-jobs-in-a-workflow

As a rule of thumb, generally, PR authors should request a review & get a PR approval from the respective companies' CODEOWNERS before requesting a review from core maintainers.

If additional help is needed, PR authors can reach out to core maintainers over Slack.

2 similar comments
@github-actions
Copy link
Copy Markdown
Contributor

Thanks for the contribution! For vLLM & SGLang, please ensure that your recipes is similar to the official vLLM recipes and/or the SGLang cookbook

If it is not, please create a PR first before we can merge your single node PR into the master branch. Let's ensure that the documentation is first class such that the entire ML community can benefit from your hard work! Thank you

PR authors are responsible for ensuring that after merging, all GitHub Action jobs fully pass. A lot of the time, failures are just flakes and simply re-running the failed jobs will fix it. If re-running failed jobs is attempted, PR authors are responsible for ensuring it passes. See GitHub's docs on re-running failed jobs: https://docs.github.com/en/actions/how-tos/manage-workflow-runs/re-run-workflows-and-jobs#re-running-failed-jobs-in-a-workflow

As a rule of thumb, generally, PR authors should request a review & get a PR approval from the respective companies' CODEOWNERS before requesting a review from core maintainers.

If additional help is needed, PR authors can reach out to core maintainers over Slack.

@github-actions
Copy link
Copy Markdown
Contributor

Thanks for the contribution! For vLLM & SGLang, please ensure that your recipes is similar to the official vLLM recipes and/or the SGLang cookbook

If it is not, please create a PR first before we can merge your single node PR into the master branch. Let's ensure that the documentation is first class such that the entire ML community can benefit from your hard work! Thank you

PR authors are responsible for ensuring that after merging, all GitHub Action jobs fully pass. A lot of the time, failures are just flakes and simply re-running the failed jobs will fix it. If re-running failed jobs is attempted, PR authors are responsible for ensuring it passes. See GitHub's docs on re-running failed jobs: https://docs.github.com/en/actions/how-tos/manage-workflow-runs/re-run-workflows-and-jobs#re-running-failed-jobs-in-a-workflow

As a rule of thumb, generally, PR authors should request a review & get a PR approval from the respective companies' CODEOWNERS before requesting a review from core maintainers.

If additional help is needed, PR authors can reach out to core maintainers over Slack.

@github-actions
Copy link
Copy Markdown
Contributor

Copy link
Copy Markdown
Contributor

@claude claude Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, straightforward SGLang image version bump (v0.5.11-cu130 → v0.5.12-cu130) with matching changelog entry.

Extended reasoning...

Overview

This PR bumps the SGLang container image for two recipes (qwen3.5-fp4-b300-sglang and qwen3.5-fp4-b300-sglang-mtp) from v0.5.11-cu130 to v0.5.12-cu130 in .github/configs/nvidia-master.yaml, and appends a corresponding entry to perf-changelog.yaml linking back to this PR.

Security risks

None. This is a pinned upstream image version tag bump in CI config. The image source (lmsysorg/sglang) is unchanged, only the version tag advances by a patch release.

Level of scrutiny

Low. This is a mechanical, config-only change with no logic, no auth/crypto, and no production code paths. It follows the exact same pattern as numerous prior image-bump PRs in this repo (e.g. the recent #1458 entry directly above it in the changelog).

Other factors

The PR carries the full-sweep-enabled label so CI sweeps will validate the new image. No bugs were found by the bug hunting system, and there are no outstanding human reviewer comments — only the standard recipe-reminder bot messages.

@functionstackx
Copy link
Copy Markdown
Collaborator Author

Same vision-encoder workaround as PRs #1422 / #1451

Confirmed same flash-attn-4 cute sm_103 assertion in the Qwen-3.5-VL vision encoder — all 24 8k1k jobs failed with flash_fwd_sm100.py:162 AssertionError (1k1k may survive since vision encoder isn't exercised during warmup). Same family as the bf16 (#1422) and fp8 (#1451) siblings.

Added --mm-attention-backend triton_attn to both qwen3.5_fp4_b300.sh and qwen3.5_fp4_b300_mtp.sh. Pushed as 108982c2. Text decoder stays on trtllm_mha.

Upstream / root cause cross-links

Once either upstream lands, this workaround can come back out.

@github-actions
Copy link
Copy Markdown
Contributor

@github-actions
Copy link
Copy Markdown
Contributor

1 similar comment
@github-actions
Copy link
Copy Markdown
Contributor

@functionstackx functionstackx changed the title [Klaud Cold] Update qwen3.5-fp4-b300-sglang (+mtp) SGLang image to v0.5.12-cu130 [Handoff to @Oseltamivir Claude /loop] [Klaud Cold] Update qwen3.5-fp4-b300-sglang (+mtp) SGLang image to v0.5.12-cu130 May 18, 2026
@functionstackx
Copy link
Copy Markdown
Collaborator Author

Handing off to @Oseltamivir — tracked alongside 7 other stuck Klaud-Cold PRs in #1511. /loop will stop auto-retrying this one.

AI-generated via Claude Code /loop.

functionstackx and others added 3 commits May 20, 2026 01:47
Update SGLang image from v0.5.11-cu130 (5d old) to v0.5.12-cu130

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Same workaround as #1422 (bf16) and #1451 (fp8) — bypass the broken
flash-attn cute kernel sm_103 assertion in the Qwen-3.5-VL vision
encoder by switching only the multi-modal attention path to triton_attn.
Text decoder still uses --attention-backend trtllm_mha.

See sgl-project/sglang#25564 (root cause: cutedsl Arch enum aliasing on
non-cu13 path collapses sm_100..sm_110f range to exclude sm_103) and
Dao-AILab/flash-attention#2572 for the upstream fix in flight.
@functionstackx functionstackx force-pushed the update-qwen3.5-fp4-b300-sglang-v0.5.12 branch from bfac96d to b8f0cd5 Compare May 20, 2026 05:47
@functionstackx functionstackx changed the title [Handoff to @Oseltamivir Claude /loop] [Klaud Cold] Update qwen3.5-fp4-b300-sglang (+mtp) SGLang image to v0.5.12-cu130 [Klaud Cold] Update qwen3.5-fp4-b300-sglang (+mtp) SGLang image to v0.5.12-cu130 May 20, 2026
@github-actions
Copy link
Copy Markdown
Contributor

@functionstackx
Copy link
Copy Markdown
Collaborator Author

/reuse-sweep-run

@functionstackx functionstackx merged commit 4f63034 into main May 20, 2026
3 of 5 checks passed
@functionstackx functionstackx deleted the update-qwen3.5-fp4-b300-sglang-v0.5.12 branch May 20, 2026 07:00
@github-actions
Copy link
Copy Markdown
Contributor

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

Development

Successfully merging this pull request may close these issues.

1 participant