0
代码
代码
Issues
Pull Requests
讨论
Wiki
分析
0
ascend-robotascend-robot[mindspore] support qwen3vl finetune for megatron backend
8549f54b创建于 2025年11月21日历史提交
文件最后提交记录最后更新时间
data_balance
[Modify] hetero-pp support encoder/decoder different micro-batch-size & improve qwen2.5omni data balance on global batch Co-authored-by: huangdabiao<huangdabiao1@huawei.com> # message auto-generated for no-merge-commit merge: !1736 merge test_final_1111 into master [Modify] hetero-pp support encoder/decoder different micro-batch-size & improve qwen2.5omni data balance on global batch Created-by: huangdabiao Commit-by: huangdabiao Merged-by: ascend-robot Description: ## Motivation [Modify] hetero-pp support encoder/decoder different micro-batch-size & improve qwen2.5omni data balance on global batch ## Modification [Modify] hetero-pp support encoder/decoder different micro-batch-size & improve qwen2.5omni data balance on global batch ## Self-test (Optional) If modifications to this PR may cause/fix function/accuracy/performance DTSs/issues, a self-inspection record needs to be attached. ## BC-breaking (Optional) If there are compatibility issues, such as dependencies on cann/torch_npu versions, they need to be explained in the PR. ## Checklist **Before PR**: - [ ] The new code needs to comply with the Clean Code specification. - [ ] The PR content is self-checked, and the expression can be clear and the writing standardized **After PR**: - [ ] CLA has been signed and all committers have signed the CLA in this PR. - [ ] The ci-pipeline is passed, Code Check is passed. See merge request: Ascend/MindSpeed-MM!17366 个月前
extra_processor
[Bugfix] fix wan2.1 feature extract Co-authored-by: 林明哲<linmingzhe3@huawei.com> # message auto-generated for no-merge-commit merge: !1720 merge fix1107 into master [Bugfix] fix wan2.1 feature extract Created-by: LinMingZhe Commit-by: 林明哲 Merged-by: ascend-robot Description: ## Motivation fix wan2.1 feature extract ## Modification fix image encoder check ## Checklist **Before PR**: - [ ] The new code needs to comply with the Clean Code specification. - [ ] The PR content is self-checked, and the expression can be clear and the writing standardized **After PR**: - [ ] CLA has been signed and all committers have signed the CLA in this PR. - [ ] The ci-pipeline is passed, Code Check is passed. See merge request: Ascend/MindSpeed-MM!17206 个月前
security_utils
!1297 [Bugfix]Security Update: Remove OS Info Print, Defend Formula Injection, Add Security Utils, Disable 0.0.0.0 and add public IP Merge pull request !1297 from zhangxubin/master 10 个月前
async_offload.py
!1280 [Bugfix] asyc offload supports starting from layers other than layer 0. Merge pull request !1280 from liyingxuan/master 10 个月前
auto_setting.py
MM disttrain intervl2 适配自动并行搜索 Co-authored-by: gcw_amOUPDs9<fuyuefeng@huawei.com> # message auto-generated for no-merge-commit merge: !1588 merge master into master MM disttrain intervl2 适配自动并行搜索 Created-by: gcw_amOUPDs9 Commit-by: gcw_amOUPDs9 Merged-by: ascend-robot Description: ## Motivation Please describe the motivation of this PR and the goal you want to achieve through this PR. ## Modification Please briefly describe what modification is made in this PR. ## Self-test (Optional) If modifications to this PR may cause/fix function/accuracy/performance DTSs/issues, a self-inspection record needs to be attached. ## BC-breaking (Optional) If there are compatibility issues, such as dependencies on cann/torch_npu versions, they need to be explained in the PR. ## Checklist **Before PR**: - [x] The new code needs to comply with the Clean Code specification. - [x] The PR content is self-checked, and the expression can be clear and the writing standardized **After PR**: - [x] CLA has been signed and all committers have signed the CLA in this PR. - [x] The ci-pipeline is passed, Code Check is passed. See merge request: Ascend/MindSpeed-MM!15886 个月前
dpcp_utils.py
[Feature]opensoraplan1.3新增动态DPCP切换功能 Co-authored-by: qusongyun1<qusongyun1@noreply.gitcode.com> # message auto-generated for no-merge-commit merge: !1677 merge dynamicDPCP into master [Feature]opensoraplan1.3新增动态DPCP切换功能 Created-by: qusongyun1 Commit-by: qusongyun1 Merged-by: ascend-robot Description: ## Motivation 当前静态DPCP方案在动态负载下无法充分利用算力，例如在大量短序列和少量长序列的情况下，为了保证不OOM，需要设置较大的CP，然而短序列进行大CP并行会导致性能的下降。本特性新增动态DPCP功能，支持在每轮训练迭代中根据数据特征动态切换DP/CP并行策略。 ## Modification pretrain_sora.py：如果开启了动态DPCP，则优先获取缓存数据 training.py: 在初始化时，新增DPCP并行组的初始化，切换后，将数据在cp组内广播并放入缓存 MindSpeed-MM/mindspeed_mm/utils 中新增dpcp_utils.py文件，所有本特性相关的函数实现均在该文件中 ## Self-test (Optional) If modifications to this PR may cause/fix function/accuracy/performance DTSs/issues, a self-inspection record needs to be attached. ## BC-breaking (Optional) If there are compatibility issues, such as dependencies on cann/torch_npu versions, they need to be explained in the PR. ## Checklist **Before PR**: - [x] The new code needs to comply with the Clean Code specification. - [x] The PR content is self-checked, and the expression can be clear and the writing standardized **After PR**: - [x] CLA has been signed and all committers have signed the CLA in this PR. - [x] The ci-pipeline is passed, Code Check is passed. See merge request: Ascend/MindSpeed-MM!16776 个月前
ema.py
!587 【特性】VAE添加判别器以及数据集等模块 Merge pull request !587 from zs-Derrick/master 1 年前
hetero_parallel.py
[Bugfix] Fallback to older Hetero-Parallel Data Comm Co-authored-by: mazhuang<mazhuang21@huawei.com> # message auto-generated for no-merge-commit merge: !1706 merge new-comm-group-revert into master [Bugfix] Fallback to older Hetero-Parallel Data Comm Created-by: mazhuang1234 Commit-by: mazhuang Merged-by: ascend-robot Description: ## Motivation 新版通信优化与Hetero-Parallel 流水线并行冲突，需要回调到老版Hetero数据流通信 ## Modification Please briefly describe what modification is made in this PR. ## Self-test (Optional) If modifications to this PR may cause/fix function/accuracy/performance DTSs/issues, a self-inspection record needs to be attached. ## BC-breaking (Optional) If there are compatibility issues, such as dependencies on cann/torch_npu versions, they need to be explained in the PR. ## Checklist **Before PR**: - [ ] The new code needs to comply with the Clean Code specification. - [ ] The PR content is self-checked, and the expression can be clear and the writing standardized **After PR**: - [ ] CLA has been signed and all committers have signed the CLA in this PR. - [ ] The ci-pipeline is passed, Code Check is passed. See merge request: Ascend/MindSpeed-MM!17066 个月前
mask_utils.py
!259 【特性】OpenSoraPlan 1.3 添加 I2V 训练 Merge pull request !259 from zzztq/master 1 年前
random.py
!1492 [Modify] Update deterministic computation Merge pull request !1492 from 王泽/deter_comp 8 个月前
transformer_model_config.py
[mindspore] support qwen3vl finetune for megatron backend Co-authored-by: ffmh<fengminghao2@huawei.com> # message auto-generated for no-merge-commit merge: !1785 merge qwen3vl_megatron into master [mindspore] support qwen3vl finetune for megatron backend Created-by: ffmh Commit-by: ffmh Merged-by: ascend-robot Description: ## Motivation Please describe the motivation of this PR and the goal you want to achieve through this PR. 适配 qwen3vl 8B/30B megatron后端 ## Modification Please briefly describe what modification is made in this PR. 添加 layer_spec修改、text模块transformer block/layer添加deepstack相关适配 ## Self-test (Optional) If modifications to this PR may cause/fix function/accuracy/performance DTSs/issues, a self-inspection record needs to be attached. ## BC-breaking (Optional) If there are compatibility issues, such as dependencies on cann/torch_npu versions, they need to be explained in the PR. ## Checklist **Before PR**: - [ ] The new code needs to comply with the Clean Code specification. - [ ] The PR content is self-checked, and the expression can be clear and the writing standardized **After PR**: - [ ] CLA has been signed and all committers have signed the CLA in this PR. - [ ] The ci-pipeline is passed, Code Check is passed. See merge request: Ascend/MindSpeed-MM!17856 个月前
utils.py
[mindspore] support qwen3vl finetune for megatron backend Co-authored-by: ffmh<fengminghao2@huawei.com> # message auto-generated for no-merge-commit merge: !1785 merge qwen3vl_megatron into master [mindspore] support qwen3vl finetune for megatron backend Created-by: ffmh Commit-by: ffmh Merged-by: ascend-robot Description: ## Motivation Please describe the motivation of this PR and the goal you want to achieve through this PR. 适配 qwen3vl 8B/30B megatron后端 ## Modification Please briefly describe what modification is made in this PR. 添加 layer_spec修改、text模块transformer block/layer添加deepstack相关适配 ## Self-test (Optional) If modifications to this PR may cause/fix function/accuracy/performance DTSs/issues, a self-inspection record needs to be attached. ## BC-breaking (Optional) If there are compatibility issues, such as dependencies on cann/torch_npu versions, they need to be explained in the PR. ## Checklist **Before PR**: - [ ] The new code needs to comply with the Clean Code specification. - [ ] The PR content is self-checked, and the expression can be clear and the writing standardized **After PR**: - [ ] CLA has been signed and all committers have signed the CLA in this PR. - [ ] The ci-pipeline is passed, Code Check is passed. See merge request: Ascend/MindSpeed-MM!17856 个月前