Skip to content

fix qwen3.5 dynamic-cp#141

Merged
ISEEKYAN merged 1 commit into
mainfrom
gyhe/dynamic-cp-for-qwen3.5
May 18, 2026
Merged

fix qwen3.5 dynamic-cp#141
ISEEKYAN merged 1 commit into
mainfrom
gyhe/dynamic-cp-for-qwen3.5

Conversation

@Thaurun
Copy link
Copy Markdown
Collaborator

@Thaurun Thaurun commented May 18, 2026

No description provided.

@ISEEKYAN ISEEKYAN merged commit af4e558 into main May 18, 2026
0 of 2 checks passed
from megatron.core.packed_seq_params import PackedSeqParams
from megatron.core.transformer import MegatronModule
from megatron.core.transformer.spec_utils import ModuleSpec
from megatron.core.extensions.transformer_engine import get_thd_partitioned_indices
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have a question: from megatron.core.extensions.transformer_engine import get_thd_partitioned_indices doesn't exist in megatron-lm, causing a qwen3.5 error when Verl uses mbridge.
Have you encountered this problem before? Thanks~

Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have a question: from megatron.core.extensions.transformer_engine import get_thd_partitioned_indices doesn't exist in megatron-lm, causing a qwen3.5 error when Verl uses mbridge. Have you encountered this problem before? Thanks~

@AlchemistD sorry for the compatibility issue, just reverted this PR.
@Thaurun please help with the compatibility, I don't find the get_thd_partitioned_indices in megatron or TE repo now.

ISEEKYAN added a commit that referenced this pull request May 18, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants