0
代码
代码
Issues
Pull Requests
讨论
Wiki
分析
0
ascend-robotascend-robot[mindspore] support qwen3vl finetune for megatron backend
8549f54b创建于 2025年11月21日历史提交
文件最后提交记录最后更新时间
deepseekvl_layer_spec.py
!1049 [Refactor]adapt mindspeed012 Merge pull request !1049 from 王泽/adapt012 9 个月前
get_layer_spec.py
[mindspore] support qwen3vl finetune for megatron backend Co-authored-by: ffmh<fengminghao2@huawei.com> # message auto-generated for no-merge-commit merge: !1785 merge qwen3vl_megatron into master [mindspore] support qwen3vl finetune for megatron backend Created-by: ffmh Commit-by: ffmh Merged-by: ascend-robot Description: ## Motivation Please describe the motivation of this PR and the goal you want to achieve through this PR. 适配 qwen3vl 8B/30B megatron后端 ## Modification Please briefly describe what modification is made in this PR. 添加 layer_spec修改、text模块transformer block/layer添加deepstack相关适配 ## Self-test (Optional) If modifications to this PR may cause/fix function/accuracy/performance DTSs/issues, a self-inspection record needs to be attached. ## BC-breaking (Optional) If there are compatibility issues, such as dependencies on cann/torch_npu versions, they need to be explained in the PR. ## Checklist **Before PR**: - [ ] The new code needs to comply with the Clean Code specification. - [ ] The PR content is self-checked, and the expression can be clear and the writing standardized **After PR**: - [ ] CLA has been signed and all committers have signed the CLA in this PR. - [ ] The ci-pipeline is passed, Code Check is passed. See merge request: Ascend/MindSpeed-MM!17856 个月前
glm4v_layer_spec.py
!1383 [Feature] GLM4.1V: Add LLM FA + Fused RoPE & RMSNorm, Compatible with Megatron 012 Merge pull request !1383 from shaojieMike/glm_0815_perf 9 个月前
internvl_layer_spec.py
!1049 [Refactor]adapt mindspeed012 Merge pull request !1049 from 王泽/adapt012 9 个月前
llava_layer_spec.py
!1049 [Refactor]adapt mindspeed012 Merge pull request !1049 from 王泽/adapt012 9 个月前
qwen2_5omni_layer_spec.py
!1049 [Refactor]adapt mindspeed012 Merge pull request !1049 from 王泽/adapt012 9 个月前
qwen2vl_layer_spec.py
[Bugfix] add import infomation in qwen2vl layerspec Co-authored-by: chenpeizhe<chenpeizhe1@huawei.com> # message auto-generated for no-merge-commit merge: !1659 merge master into master [Bugfix] add import infomation in qwen2vl layerspec Created-by: chenpeizhe Commit-by: chenpeizhe Merged-by: ascend-robot Description: ## Motivation add import infomation in qwen2vl layerspec ## Modification add import infomation in qwen2vl layerspec ## Self-test (Optional) If modifications to this PR may cause/fix function/accuracy/performance DTSs/issues, a self-inspection record needs to be attached. ## BC-breaking (Optional) If there are compatibility issues, such as dependencies on cann/torch_npu versions, they need to be explained in the PR. ## Checklist **Before PR**: - [x] The new code needs to comply with the Clean Code specification. - [x] The PR content is self-checked, and the expression can be clear and the writing standardized **After PR**: - [x] CLA has been signed and all committers have signed the CLA in this PR. - [x] The ci-pipeline is passed, Code Check is passed. See merge request: Ascend/MindSpeed-MM!16597 个月前
qwen3vl_layer_spec.py
[mindspore] support qwen3vl finetune for megatron backend Co-authored-by: ffmh<fengminghao2@huawei.com> # message auto-generated for no-merge-commit merge: !1785 merge qwen3vl_megatron into master [mindspore] support qwen3vl finetune for megatron backend Created-by: ffmh Commit-by: ffmh Merged-by: ascend-robot Description: ## Motivation Please describe the motivation of this PR and the goal you want to achieve through this PR. 适配 qwen3vl 8B/30B megatron后端 ## Modification Please briefly describe what modification is made in this PR. 添加 layer_spec修改、text模块transformer block/layer添加deepstack相关适配 ## Self-test (Optional) If modifications to this PR may cause/fix function/accuracy/performance DTSs/issues, a self-inspection record needs to be attached. ## BC-breaking (Optional) If there are compatibility issues, such as dependencies on cann/torch_npu versions, they need to be explained in the PR. ## Checklist **Before PR**: - [ ] The new code needs to comply with the Clean Code specification. - [ ] The PR content is self-checked, and the expression can be clear and the writing standardized **After PR**: - [ ] CLA has been signed and all committers have signed the CLA in this PR. - [ ] The ci-pipeline is passed, Code Check is passed. See merge request: Ascend/MindSpeed-MM!17856 个月前
videoalign_layer_spec.py
[Feature] support sparse-mode3 FA in videoalign Co-authored-by: chenpeizhe<chenpeizhe1@huawei.com> # message auto-generated for no-merge-commit merge: !1570 merge master into master [Feature] support sparse-mode3 FA in videoalign Created-by: chenpeizhe Commit-by: chenpeizhe Merged-by: ascend-robot Description: ## Motivation support sparse-mode3 FA in videoalign ## Modification support sparse-mode3 FA in videoalign ## Self-test (Optional) If modifications to this PR may cause/fix function/accuracy/performance DTSs/issues, a self-inspection record needs to be attached. ## BC-breaking (Optional) If there are compatibility issues, such as dependencies on cann/torch_npu versions, they need to be explained in the PR. ## Checklist **Before PR**: - [x] The new code needs to comply with the Clean Code specification. - [x] The PR content is self-checked, and the expression can be clear and the writing standardized **After PR**: - [x] CLA has been signed and all committers have signed the CLA in this PR. - [x] The ci-pipeline is passed, Code Check is passed. See merge request: Ascend/MindSpeed-MM!15707 个月前