| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
【feature】add unified loss ctx function for fsdp2 dev Co-authored-by: weixin_44031810<gaojie75@huawei.com> # message auto-generated for no-merge-commit merge: !2084 merge fsdp2_dev into fsdp2_dev 【feature】add unified loss ctx function for fsdp2 dev Created-by: gaojie_ Commit-by: weixin_44031810 Merged-by: ascend-robot Description: ## Motivation 添加loss_ctx对各个loss进行统一管理； 对一些data_args bug进行修改 ## Modification 为FSDP2后端模型添加同意loss function管理，主要是master分支loss ctx的迁移 ## Self-test (Optional) 精度已经自研完成。 ## BC-breaking (Optional) If there are compatibility issues, such as dependencies on cann/torch_npu versions, they need to be explained in the PR. ## Checklist **Before PR**: - [ ] The new code needs to comply with the Clean Code specification. - [ ] The PR content is self-checked, and the expression can be clear and the writing standardized **After PR**: - [ ] CLA has been signed and all committers have signed the CLA in this PR. - [ ] The ci-pipeline is passed, Code Check is passed. See merge request: Ascend/MindSpeed-MM!2084 | 5 个月前 | |
【feature】add unified loss ctx function for fsdp2 dev Co-authored-by: weixin_44031810<gaojie75@huawei.com> # message auto-generated for no-merge-commit merge: !2084 merge fsdp2_dev into fsdp2_dev 【feature】add unified loss ctx function for fsdp2 dev Created-by: gaojie_ Commit-by: weixin_44031810 Merged-by: ascend-robot Description: ## Motivation 添加loss_ctx对各个loss进行统一管理； 对一些data_args bug进行修改 ## Modification 为FSDP2后端模型添加同意loss function管理，主要是master分支loss ctx的迁移 ## Self-test (Optional) 精度已经自研完成。 ## BC-breaking (Optional) If there are compatibility issues, such as dependencies on cann/torch_npu versions, they need to be explained in the PR. ## Checklist **Before PR**: - [ ] The new code needs to comply with the Clean Code specification. - [ ] The PR content is self-checked, and the expression can be clear and the writing standardized **After PR**: - [ ] CLA has been signed and all committers have signed the CLA in this PR. - [ ] The ci-pipeline is passed, Code Check is passed. See merge request: Ascend/MindSpeed-MM!2084 | 5 个月前 | |
[Feature] MM_FSDP2: Add attention patch for transformers. And add ring & usp for qwen3vl Co-authored-by: zs-derrick1<1434012475@qq.com> # message auto-generated for no-merge-commit merge: !2120 merge fsdp2_dev2 into fsdp2_dev [Feature] MM_FSDP2: Add attention patch for transformers. And add ring & usp for qwen3vl Created-by: zs-derrick1 Commit-by: zs-derrick1 Merged-by: ascend-robot Description: ## Motivation Add attention patch for transformers. And add ring & usp for qwen3vl ## Modification 1.Add transformers attention patch to support cp（ulysses/ring/usp) 2.add ring&usp for qwen3vl ## Self-test (Optional) If modifications to this PR may cause/fix function/accuracy/performance DTSs/issues, a self-inspection record needs to be attached. ## BC-breaking (Optional) If there are compatibility issues, such as dependencies on cann/torch_npu versions, they need to be explained in the PR. ## Checklist **Before PR**: - [x] The new code needs to comply with the Clean Code specification. - [x] The PR content is self-checked, and the expression can be clear and the writing standardized **After PR**: - [x] CLA has been signed and all committers have signed the CLA in this PR. - [x] The ci-pipeline is passed, Code Check is passed. See merge request: Ascend/MindSpeed-MM!2120 | 4 个月前 | |
[Refactor]MM_FSDP2 engine relying on core changes from lite to fsdp Co-authored-by: zs-derrick1<1434012475@qq.com> # message auto-generated for no-merge-commit merge: !2071 merge fsdp2_dev into fsdp2_dev [Refactor]MM_FSDP2 engine relying on core changes from lite to fsdp Created-by: zs-derrick1 Commit-by: zs-derrick1 Merged-by: ascend-robot Description: [Refactor]MM_FSDP2 engine relying on core changes from lite to fsdp See merge request: Ascend/MindSpeed-MM!2071 | 5 个月前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 5 个月前 | ||
| 5 个月前 | ||
| 4 个月前 | ||
| 5 个月前 |