| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
[feature] support ep resume Co-authored-by: htwang<wanghaitao60@huawei.com> # message auto-generated for no-merge-commit merge: !2143 merge fsdp2_dev into fsdp2_dev [feature] support ep resume Created-by: htwang Commit-by: htwang Merged-by: ascend-robot Description: ## Motivation 支持EP场景的断点续训 ## Modification 1、修改EP实现方式（使用distribute module实现） 2、优化器状态适配EP场景保存和加载 ## Self-test (Optional) If modifications to this PR may cause/fix function/accuracy/performance DTSs/issues, a self-inspection record needs to be attached. ## BC-breaking (Optional) If there are compatibility issues, such as dependencies on cann/torch_npu versions, they need to be explained in the PR. ## Checklist **Before PR**: - [ ] The new code needs to comply with the Clean Code specification. - [ ] The PR content is self-checked, and the expression can be clear and the writing standardized **After PR**: - [ ] CLA has been signed and all committers have signed the CLA in this PR. - [ ] The ci-pipeline is passed, Code Check is passed. See merge request: Ascend/MindSpeed-MM!2143 | 5 个月前 | |
[Feature] qwen3.5 support expert parallel Co-authored-by: young256<liumingyang16@huawei.com> # message auto-generated for no-merge-commit merge: !2210 merge fsdp2_dev_qwen35_publish into fsdp2_dev [Feature] qwen3.5 support expert parallel Created-by: young256 Commit-by: young256 Merged-by: ascend-robot Description: ## Motivation Qwen3.5 MoE requires enabling expert parallelism at the 397B parameter scale to prevent Out‑of‑Memory (OOM) errors. ## Modification Supporting expert parallel for Qwen3.5 MoE ## Self-test (Optional) not involve yet ## BC-breaking (Optional) not involve ## Checklist **Before PR**: - [x] The new code needs to comply with the Clean Code specification. - [x] The PR content is self-checked, and the expression can be clear and the writing standardized **After PR**: - [x] CLA has been signed and all committers have signed the CLA in this PR. - [x] The ci-pipeline is passed, Code Check is passed. See merge request: Ascend/MindSpeed-MM!2210 | 4 个月前 | |
[Feature] qwen3.5 support expert parallel Co-authored-by: young256<liumingyang16@huawei.com> # message auto-generated for no-merge-commit merge: !2210 merge fsdp2_dev_qwen35_publish into fsdp2_dev [Feature] qwen3.5 support expert parallel Created-by: young256 Commit-by: young256 Merged-by: ascend-robot Description: ## Motivation Qwen3.5 MoE requires enabling expert parallelism at the 397B parameter scale to prevent Out‑of‑Memory (OOM) errors. ## Modification Supporting expert parallel for Qwen3.5 MoE ## Self-test (Optional) not involve yet ## BC-breaking (Optional) not involve ## Checklist **Before PR**: - [x] The new code needs to comply with the Clean Code specification. - [x] The PR content is self-checked, and the expression can be clear and the writing standardized **After PR**: - [x] CLA has been signed and all committers have signed the CLA in this PR. - [x] The ci-pipeline is passed, Code Check is passed. See merge request: Ascend/MindSpeed-MM!2210 | 4 个月前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 5 个月前 | ||
| 4 个月前 | ||
| 4 个月前 |