perf(training): parallelize SFT dataset rendering with multiprocessing#358

Open

xiaoyifan wants to merge 3 commits intomainfrom

parallel-sft-rendering

Commits on Apr 21, 2026

perf(training): parallelize SFT dataset rendering with multiprocessing
xiaoyifan
committed
fix(training): disable GC in render workers to prevent fork COW inflation
xiaoyifan
committed
fix(training): use spawn instead of fork for render workers
xiaoyifan
committed