Skip to content

fix(rl): reduce Megatron memory usage in selective_log_softmax, causal mask, and discarded logits - #283

Open
Wings-Of-Disaster wants to merge 3 commits into
modelscope:mainfrom
Wings-Of-Disaster:fix/megatron-memory-leaks
Open

Wings-Of-Disaster wants to merge 3 commits into
modelscope:mainfrom
Wings-Of-Disaster:fix/megatron-memory-leaks

fix(megatron): do not retain and cat logits that are discarded

dc92445
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning
lint
succeeded Sep 14, 2026 in 48s