Fp8 debug#2

Draft

wdykas wants to merge 82 commits into

mainfrom

Commits on Feb 5, 2026

WIP: mamba seq pack device sync is not cudagraphable
mathemakitten
committed

Commits on Feb 6, 2026

Commits on Feb 9, 2026

Commits on Feb 10, 2026

this runs reliably if you disable the fwd pass for non-training but its slower
mathemakitten
committed

Commits on Feb 13, 2026

Commits on Feb 14, 2026

cleanup and format
mathemakitten
committed

Commits on Feb 17, 2026

Commits on Feb 20, 2026

working megatron
wdykas
committed
Add megatron_tokenizer and fix distrib_optimizer
Shanmugam Ramasamy
committed
Merge shanmugam/fixes (PR #3521) into nemo-refit
wdykas
committed
Fix gradient path oop
mathemakitten
committed

Commits on Feb 23, 2026

Commits on Feb 26, 2026

backward compatability
wdykas
committed

Commits on Feb 27, 2026

Commits on Mar 2, 2026

fp8
wdykas
committed
fix
wdykas
committed

Commits on Mar 4, 2026

fixed
William Dykas
committed
cleanup
William Dykas
committed

Commits on Mar 5, 2026

debug
William Dykas
committed
refactr and debuggin
William Dykas
committed

Commits on Mar 6, 2026

Commits on Mar 7, 2026

Update copy-pr-bot.yaml [skip ci]
github-actions[bot]
committed
merge main
William Dykas
committed
lint
William Dykas
committed
remove the cpp
William Dykas
committed

Commits on Mar 8, 2026

revert
William Dykas
committed

Commits on Mar 9, 2026

[bugfix] fix the bug that loss: 0 will not be printed (#1555)

leisuzz
and
Phlip79
authored
Fused dLN + add in backwards pass (#3384)

authored
chore(beep boop 🤖): Bump (main) (2026-03-09)
github-actions[bot]
committed
add test
William Dykas
committed
Claude: run actions on target branch (#3745)
Phlip79
authored
revert of #2658 (#3736)
dimapihtar
authored
Update README Quick Start (#3596)

ilml
and
ericharper
authored
comments

root
authored and
root
committed
Re-enable tests which were failing on #3373 (#3757)
mathemakitten
authored
Check reviews properly (#3756)
Phlip79
authored

Commits on Mar 10, 2026