Merge branch "hpcaitech:main" into feature/layer_spec#3

Open

YuliangLiu0306 wants to merge 3475 commits into

YuliangLiu0306:feature/layer_specfrom

This pull request is big! We're only showing the most recent 250 commits

Commits on Oct 15, 2024

Commits on Oct 16, 2024

Commits on Oct 17, 2024

Commits on Oct 18, 2024

[fp8] add fallback and make compile option configurable (#6092)
ver217
authored
[misc] fit torch api upgradation and remove legecy import (#6093)
ver217
authored

Commits on Oct 24, 2024

Commits on Oct 31, 2024

Commits on Nov 4, 2024

[release] update version (#6109)
ver217
authored

Commits on Nov 5, 2024

[plugin] support get_grad_norm (#6115)
ver217
authored

Commits on Nov 6, 2024

update readme (#6116)
TongLi3701
authored

Commits on Nov 8, 2024

[Coati] Refine prompt for better inference (#6117)

TongLi3701
and
pre-commit-ci[bot]
authored

Commits on Nov 12, 2024

[zero] support extra dp (#6123)
ver217
authored

Commits on Nov 14, 2024

Commits on Nov 20, 2024

[doc] add hpc cloud intro (#6147)

Sze-qq
and
Siqi
authored
[optim] hotfix adam load (#6146)

ver217
and
pre-commit-ci[bot]
authored
[doc] update cloud link (#6148)

Sze-qq
and
Siqi
authored

Commits on Nov 21, 2024

Commits on Nov 25, 2024

[checkpointio] fix zero optimizer async save memory (#6151)
ver217
authored

Commits on Dec 2, 2024

[checkpointio] support debug log (#6153)
ver217
authored

Commits on Dec 10, 2024

Commits on Dec 16, 2024

[checkpointio] fix async io (#6155)
flybird11111
authored

Commits on Dec 17, 2024

[Device]Support npu (#6159)

flybird11111
and
pre-commit-ci[bot]
authored

Commits on Dec 25, 2024

[checkpointio] support non blocking pin load (#6172)

ver217
and
pre-commit-ci[bot]
authored

Commits on Jan 2, 2025

Commits on Jan 3, 2025

[release] update version (#6174)
ver217
authored

Commits on Jan 7, 2025

[checkpointio] support load-pin overlap (#6177)

ver217
and
pre-commit-ci[bot]
authored

Commits on Jan 8, 2025

[Inference]Fix example in readme (#6178)
GuangyaoZhang
authored

Commits on Jan 21, 2025

[checkpointio] gather tensor before unpad it if the tensor is both padded and distributed (#6168)
Lemon-412
authored

Commits on Jan 24, 2025

[Issue template] Add checkbox asking for details to reproduce error (#6104)
Edenzzzz
authored

Commits on Feb 6, 2025

[hotfix] fix hybrid checkpointio for sp+dp (#6184)

flybird11111
and
pre-commit-ci[bot]
authored

Commits on Feb 11, 2025

[shardformer] support ep for deepseek v3 (#6185)

ver217
and
pre-commit-ci[bot]
authored

Commits on Feb 12, 2025

Commits on Feb 14, 2025

Commits on Feb 19, 2025

[doc] DeepSeek V3/R1 news (#6199)

binmakeswell
and
pre-commit-ci[bot]
authored

Commits on Feb 24, 2025

[misc] update torch version (#6206)
ver217
authored

Commits on Mar 1, 2025

[hotfix] fix lora load (#6231)
ver217
authored

Commits on Mar 3, 2025

[release] update version (#6236)
ver217
authored

Commits on Mar 7, 2025

[HotFix] update load lora model Readme; (#6240)
duanjunwen
authored

Commits on Apr 17, 2025

Update README.md (#6268)
Yanjia0
authored

Commits on Apr 18, 2025

[ci] update ci (#6254)

flybird11111
and
pre-commit-ci[bot]
authored

Commits on May 28, 2025

Commits on May 29, 2025

Commits on Jun 4, 2025

Merge pull request #6340 from hpcaitech/release/v0.5.0
BurkeHulk
authored

Commits on Jul 10, 2025

[feat] support qwen3 in shardformer
botbw
authored

Commits on Jul 14, 2025

Commits on Jul 15, 2025

Merge pull request #6362 from hpcaitech/CI/test_build_on_schedule
BurkeHulk
authored

Commits on Aug 5, 2025

[chat] add distributed impl (#6210)

ver217
authored and
YeAnbang
committed
[feature] fit RL style generation (#6213)

ver217
authored and
YeAnbang
committed
add reward related function

TongLi3701
authored and
YeAnbang
committed
add simple grpo

TongLi3701
authored and
YeAnbang
committed
update grpo

TongLi3701
authored and
YeAnbang
committed
polish

TongLi3701
authored and
YeAnbang
committed
modify data loader

Tong Li
authored and
YeAnbang
committed
grpo consumer

Tong Li
authored and
YeAnbang
committed
update loss

Tong Li
authored and
YeAnbang
committed
update reward fn

Tong Li
authored and
YeAnbang
committed
update example

Tong Li
authored and
YeAnbang
committed
update loader

Tong Li
authored and
YeAnbang
committed
add algo selection

Tong Li
authored and
YeAnbang
committed
add save

Tong Li
authored and
YeAnbang
committed
update select algo

Tong Li
authored and
YeAnbang
committed
[pre-commit.ci] auto fixes from pre-commit.com hooks

pre-commit-ci[bot]
authored and
YeAnbang
committed
[pre-commit.ci] auto fixes from pre-commit.com hooks

pre-commit-ci[bot]
authored and
YeAnbang
committed
update grpo

Tong Li
authored and
YeAnbang
committed
update reward fn

Tong Li
authored and
YeAnbang
committed
update reward

Tong Li
authored and
YeAnbang
committed
fix reward score

Tong Li
authored and
YeAnbang
committed
add response length

Tong Li
authored and
YeAnbang
committed
detach

Tong Li
authored and
YeAnbang
committed
fix tp bug

Tong Li
authored and
YeAnbang
committed
fix consumer

Tong Li
authored and
YeAnbang
committed
convert to 8 generation

Tong Li
authored and
YeAnbang
committed
print results

Tong Li
authored and
YeAnbang
committed
setup update

Tong Li
authored and
YeAnbang
committed
fix transformers backend
YeAnbang
committed
[Feature] Support Distributed LogProb for GRPO Training (#6247)

authored and
YeAnbang
committed
fix vllm
YeAnbang
committed
fix logprob, add filtering, temperature annealing, lr descent
YeAnbang
committed
simplify vllm preprocessing input ids
YeAnbang
committed
update logging
YeAnbang
committed
[feat] add microbatch forwarding (#6251)

YeAnbang
and
pre-commit-ci[bot]
committed
[Distributed RLHF] Integration of PP (#6257)

YeAnbang
and
Tong Li
committed
[hot-fix] Fix memory leakage bug, support TP+PP (#6258)

YeAnbang
and
Tong Li
committed
add prompt template (#6273)

authored and
YeAnbang
committed
[feat] Add final save at the end (#6274)

TongLi3701
authored and
YeAnbang
committed
[feat] Support DAPO (#6263)

committed
fix checkpoint naming; add num_epoch parameter (#6277)
YeAnbang
committed
fix save issue (#6279)

authored and
YeAnbang
committed
fix pp+tp, fix dataloader (#6280)
YeAnbang
committed
[feat] Support boxed math reward (#6284)
YeAnbang
committed
[feat] Sync shard model (#6289)

committed
Support evaluation during training
YeAnbang
committed
reuse comm-group
YeAnbang
committed
fix bug
YeAnbang
committed
upgrade reward math verification
YeAnbang
committed
rewrite reward fn
YeAnbang
committed
[fix] revert reward update and evaluation (#6295)
YeAnbang
committed
update pad seq (#6303)

authored and
YeAnbang
committed
Support evaluation during training
YeAnbang
committed
move logging to producer
YeAnbang
committed
[feat] Support prompt level dynamic (#6300)

authored and
YeAnbang
committed
use consumer global step
YeAnbang
committed
disable wandb tb syncing
YeAnbang
committed
move prompt-level-filtering to buffer side
YeAnbang
committed
move prompt-level-filtering to buffer side
YeAnbang
committed
remove redundant code and fix bugs
YeAnbang
committed
handle empty index

Tong Li
authored and
YeAnbang
committed
fix evaluation
YeAnbang
committed
address conversation
YeAnbang
committed
support logging rollouts to wandb
YeAnbang
committed
upgrade reward functions
YeAnbang
committed
fix logging rollouts
YeAnbang
committed
fix metric calculation
YeAnbang
committed
add uuid to rollout log
YeAnbang
committed
fix empty tensor (#6319)

authored and
YeAnbang
committed
fix missing tags parameter
YeAnbang
committed
address conversation
YeAnbang
committed
fix default eval setting (#6321)

authored and
YeAnbang
committed
address conversation
YeAnbang
committed
add overlength sample count (#6332)

authored and
YeAnbang
committed
[pre-commit.ci] auto fixes from pre-commit.com hooks

pre-commit-ci[bot]
authored and
YeAnbang
committed
fix typ and parameter description
YeAnbang
committed
support code generation tasks
YeAnbang
committed
fix bug, tested
YeAnbang
committed
remove debug code
YeAnbang
committed
[pre-commit.ci] auto fixes from pre-commit.com hooks

pre-commit-ci[bot]
authored and
YeAnbang
committed
move out evaluation func (#6343)

authored and
YeAnbang
committed
fix pp memory issue (#6344)

authored and
YeAnbang
committed
Manually schedule resources and support auto master address assigning
YeAnbang
committed
modify readme
YeAnbang
committed
update readme
YeAnbang
committed
add ray timeout handling instruction
YeAnbang
committed
Update README.md
YeAnbang
committed
fix num_update_per_episode
YeAnbang
committed
optimize pp log_softmax OOM
YeAnbang
committed
implement memory efficient logprob
YeAnbang
committed
fix small bug
YeAnbang
committed
add dp rank for multi-dp (#6351)

authored and
YeAnbang
committed
[feat[ Support one-behind to reduce bubble time. Add profiling code (#6353)

YeAnbang
and
Tong Li
committed
fix code evaluation
YeAnbang
committed
fix style
YeAnbang
committed
add entropy (#6363)
YeAnbang
committed
hotfix entropy calculation (#6364)
YeAnbang
committed
[Fix] Add L2 Regularization (#6372)

YeAnbang
and
pre-commit-ci[bot]
committed
fix missing or wrong file during rebase
YeAnbang
committed

Commits on Aug 6, 2025

Commits on Aug 12, 2025

support resume training
YeAnbang
committed

Commits on Aug 13, 2025

Commits on Aug 15, 2025

Commits on Aug 18, 2025

Merge pull request #6378 from hpcaitech/grpo-latest-rebase-fix-resume
YeAnbang
authored

Commits on Aug 26, 2025

[Ring Attention] Add more detailed references (#6294)
Edenzzzz
authored

Commits on Sep 3, 2025

Add new implementations of RL algorithms (#6383)

sglucas
and
pre-commit-ci[bot]
authored

Commits on Sep 26, 2025

update B200 info/img/benchmark (#6385)

Yanjia0
and
pre-commit-ci[bot]
authored

Commits on Nov 10, 2025

fix readme
YeAnbang
committed

Commits on Nov 11, 2025

fix ci; specify flash-attn version
YeAnbang
committed

Commits on Nov 12, 2025

fix ci; remove test cases that failed on 3080 (those with tps), can pass locally
YeAnbang
committed

Commits on Nov 13, 2025

Merge pull request #6391 from hpcaitech/grpo-zero-bubble-rebase
YeAnbang
authored

Commits on Apr 9, 2026