feat: support SD3.5 GRPO training#4

Open

niehen6174 wants to merge 22 commits into

mainfrom

feat/support_sd3

Commits on May 1, 2026

Merge diffusion_RL_v0.1 into support_sd3
niehen6174
committed

Commits on May 3, 2026

ShardedGradScaler fix
niehen6174
committed

Commits on May 4, 2026

fix
niehen6174
committed

Commits on May 7, 2026

temp add
niehen6174
committed

Commits on May 8, 2026

diffusion: install miles patches in sgl-d subprocesses (dtype + reductions + PipelineConfig)

niehen6174
and
cursoragent
committed
diffusion: restore cuda-IPC weight sync to sgl-d (238s → 2.9s) + script --colocate

niehen6174
and
cursoragent
committed
diffusion: use rollout's exact sigmas in actor recompute, not reconstruction

niehen6174
and
cursoragent
committed

Commits on May 11, 2026

Commits on May 20, 2026

fix: SD3 sglang rollout training fixes
niehen6174
committed
cleanup: address review feedback for SD3 merge
niehen6174
committed
cleanup: remove unused/debug-only arguments and simplify code
niehen6174
committed
fix(script): add --sglang-pipeline-class-name for SD3 sglang rollout
niehen6174
committed
fix(script): replace --sglang-pipeline-class-name with HF_TOKEN export
niehen6174
committed

Commits on May 23, 2026

fix: address non-controversial PR #4 review feedback

niehen6174
and
cursoragent
committed
refactor: remove local diffusers rollout path

niehen6174
and
cursoragent
committed
refactor: use HuggingFace datasets for SD3 OCR training script

niehen6174
and
cursoragent
committed
revert: keep flow_grpo sd3_pipeline_with_logprob as upstream reference

niehen6174
and
cursoragent
committed