| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
[Modify][MindSpore] Optimize data preprocessing performance for Qwen3vl Co-authored-by: weixin_47897441<wuyouqi1@h-partners.com> # message auto-generated for no-merge-commit merge: !1926 merge master-qwen3vl into master [Modify][MindSpore] Optimize data preprocessing performance for Qwen3vl Created-by: weixin_47897441 Commit-by: weixin_47897441 Merged-by: ascend-robot Description: ## Motivation This PR aims to optimize the performance of qwenvl3 data preprocessing by replacing partial tensor operations with tensor-to-numpy conversions, reducing unnecessary tensor memory copies and improving the overall efficiency of the preprocessing pipeline. ## Modification Replace tensor-based data operations that cause redundant memory copies with tensor-to-numpy conversion operations. ## Self-test (Optional) 1.After modification, the output of qwenvl3 data preprocessing is consistent with the original version. 2.The preprocessing time is reduced from 10xPTA to 5.2xPTA.  ## BC-breaking (Optional) If there are compatibility issues, such as dependencies on cann/torch_npu versions, they need to be explained in the PR. ## Checklist **Before PR**: - [x] The new code needs to comply with the Clean Code specification. - [x] The PR content is self-checked, and the expression can be clear and the writing standardized **After PR**: - [x] CLA has been signed and all committers have signed the CLA in this PR. - [x] The ci-pipeline is passed, Code Check is passed. See merge request: Ascend/MindSpeed-MM!1926 | 7 个月前 | |
[mindspore][master]support deepseekvl, llava, glm4.1v for mindspore backend Co-authored-by: ffmh<fengminghao2@huawei.com> # message auto-generated for no-merge-commit merge: !1671 merge ms_adapt into master [mindspore][master]support deepseekvl, llava, glm4.1v for mindspore backend Created-by: ffmh Commit-by: ffmh Merged-by: ascend-robot Description: ## Motivation deepseekvl2, llava1.5, glm4.1v 支持mindspore后端 ## Modification patch修改介绍 1. npu_rotary_position_embedding使用mindspore框架接口，不走mindspeed自定义算子流程 2. vmap接口缺失，使用等价写法替换transformers中 sdpa_mask_older_torch 函数 ## Self-test (Optional) If modifications to this PR may cause/fix function/accuracy/performance DTSs/issues, a self-inspection record needs to be attached. dsvl2  glm  llava  ## BC-breaking (Optional) If there are compatibility issues, such as dependencies on cann/torch_npu versions, they need to be explained in the PR. ## Checklist **Before PR**: - [ ] The new code needs to comply with the Clean Code specification. - [ ] The PR content is self-checked, and the expression can be clear and the writing standardized **After PR**: - [ ] CLA has been signed and all committers have signed the CLA in this PR. - [ ] The ci-pipeline is passed, Code Check is passed. See merge request: Ascend/MindSpeed-MM!1671 | 8 个月前 |
| 文件 | 最后提交记录 | 最后更新时间 |
|---|---|---|
| 7 个月前 | ||
| 8 个月前 |