Skip to content
This repository was archived by the owner on Sep 23, 2025. It is now read-only.

[Finetune] Integrate DPO trainer for CPU and Gaudi#238

Open
minmingzhu wants to merge 58 commits into
intel:mainfrom
minmingzhu:integrate_dpo
Open

[Finetune] Integrate DPO trainer for CPU and Gaudi#238
minmingzhu wants to merge 58 commits into
intel:mainfrom
minmingzhu:integrate_dpo

Conversation

@minmingzhu

Copy link
Copy Markdown
Contributor

No description provided.

Comment thread llm_on_ray/common/dataprocesser/dpo_processer.py Outdated
Comment thread llm_on_ray/finetune/finetune.py
Comment thread llm_on_ray/common/dataprocesser/dpo_processer.py Outdated
Comment thread llm_on_ray/common/dataprocesser/dpo_processer.py Outdated
Comment thread llm_on_ray/common/dataset/huggingface_dataset.py Outdated
@minmingzhu minmingzhu force-pushed the integrate_dpo branch 2 times, most recently from 2550635 to 3f66e59 Compare June 5, 2024 06:58
Comment thread llm_on_ray/finetune/finetune_config.py
Comment thread llm_on_ray/finetune/finetune.py Outdated
Comment thread llm_on_ray/finetune/finetune_config.py Outdated
Comment thread llm_on_ray/finetune/dpo_funetuing.py Outdated
minmingzhu and others added 24 commits July 2, 2024 14:31
2. remove debug log
2. add DPO CI

Signed-off-by: minmingzhu <minming.zhu@intel.com>
Signed-off-by: minmingzhu <minming.zhu@intel.com>
Signed-off-by: minmingzhu <minming.zhu@intel.com>
Signed-off-by: minmingzhu <minming.zhu@intel.com>
Signed-off-by: minmingzhu <minming.zhu@intel.com>
Signed-off-by: minmingzhu <minming.zhu@intel.com>
Signed-off-by: minmingzhu <minming.zhu@intel.com>
Signed-off-by: minmingzhu <minming.zhu@intel.com>
Signed-off-by: minmingzhu <minming.zhu@intel.com>
minmingzhu and others added 27 commits July 2, 2024 14:31
Signed-off-by: minmingzhu <minming.zhu@intel.com>
Signed-off-by: minmingzhu <minming.zhu@intel.com>
2. remove debug log
2. add DPO CI

Signed-off-by: minmingzhu <minming.zhu@intel.com>
Signed-off-by: minmingzhu <minming.zhu@intel.com>
Signed-off-by: minmingzhu <minming.zhu@intel.com>
Signed-off-by: minmingzhu <minming.zhu@intel.com>
Signed-off-by: minmingzhu <minming.zhu@intel.com>
Signed-off-by: minmingzhu <minming.zhu@intel.com>
Signed-off-by: minmingzhu <minming.zhu@intel.com>
Signed-off-by: minmingzhu <minming.zhu@intel.com>
 2. update dependencies

Signed-off-by: minmingzhu <minming.zhu@intel.com>
Signed-off-by: minmingzhu <minming.zhu@intel.com>
Signed-off-by: minmingzhu <minming.zhu@intel.com>
Signed-off-by: minmingzhu <minming.zhu@intel.com>
Signed-off-by: minmingzhu <minming.zhu@intel.com>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants