[Feature]VACE Model and Data Process
Co-authored-by: feng0w0<houyufeng4@huawei.com>
# message auto-generated for no-merge-commit merge:
!1669 merge master into master
[Feature]VACE Model and Data Process
Created-by: feng0w0
Commit-by: feng0w0
Merged-by: ascend-robot
Description: ## Motivation
Support VACE Model
## Modification
Added VACE data processing pipeline and model components.
## Self-test (Optional)
If modifications to this PR may cause/fix function/accuracy/performance DTSs/issues, a self-inspection record needs to be attached.
## BC-breaking (Optional)
If there are compatibility issues, such as dependencies on cann/torch_npu versions, they need to be explained in the PR.
## Checklist
**Before PR**:
- [ ] The new code needs to comply with the Clean Code specification.
- [ ] The PR content is self-checked, and the expression can be clear and the writing standardized
**After PR**:
- [ ] CLA has been signed and all committers have signed the CLA in this PR.
- [ ] The ci-pipeline is passed, Code Check is passed.
See merge request: Ascend/MindSpeed-MM!1669
【Bugfix】Correct the spelling errors in the code
Co-authored-by: lu-jinfu1999<lujinfu1@h-partners.com>
# message auto-generated for no-merge-commit merge:
!1670 merge master into master
【Bugfix】Correct the spelling errors in the code
Created-by: lu-jinfu1999
Commit-by: lu-jinfu1999
Merged-by: ascend-robot
Description: ## Motivation
Correct the spelling errors in the code.
## Modification
Correct spelling errors in the document.
Correct spelling errors in the code.
## Self-test (Optional)
If modifications to this PR may cause/fix function/accuracy/performance DTSs/issues, a self-inspection record needs to be attached.
## BC-breaking (Optional)
If there are compatibility issues, such as dependencies on cann/torch_npu versions, they need to be explained in the PR.
## Checklist
**Before PR**:
- [x] The new code needs to comply with the Clean Code specification.
- [x] The PR content is self-checked, and the expression can be clear and the writing standardized
**After PR**:
- [x] CLA has been signed and all committers have signed the CLA in this PR.
- [x] The ci-pipeline is passed, Code Check is passed.
See merge request: Ascend/MindSpeed-MM!1670
【Bugfix】Correct the spelling errors in the code
Co-authored-by: lu-jinfu1999<lujinfu1@h-partners.com>
# message auto-generated for no-merge-commit merge:
!1670 merge master into master
【Bugfix】Correct the spelling errors in the code
Created-by: lu-jinfu1999
Commit-by: lu-jinfu1999
Merged-by: ascend-robot
Description: ## Motivation
Correct the spelling errors in the code.
## Modification
Correct spelling errors in the document.
Correct spelling errors in the code.
## Self-test (Optional)
If modifications to this PR may cause/fix function/accuracy/performance DTSs/issues, a self-inspection record needs to be attached.
## BC-breaking (Optional)
If there are compatibility issues, such as dependencies on cann/torch_npu versions, they need to be explained in the PR.
## Checklist
**Before PR**:
- [x] The new code needs to comply with the Clean Code specification.
- [x] The PR content is self-checked, and the expression can be clear and the writing standardized
**After PR**:
- [x] CLA has been signed and all committers have signed the CLA in this PR.
- [x] The ci-pipeline is passed, Code Check is passed.
See merge request: Ascend/MindSpeed-MM!1670
【Bugfix】Correct the spelling errors in the code
Co-authored-by: lu-jinfu1999<lujinfu1@h-partners.com>
# message auto-generated for no-merge-commit merge:
!1670 merge master into master
【Bugfix】Correct the spelling errors in the code
Created-by: lu-jinfu1999
Commit-by: lu-jinfu1999
Merged-by: ascend-robot
Description: ## Motivation
Correct the spelling errors in the code.
## Modification
Correct spelling errors in the document.
Correct spelling errors in the code.
## Self-test (Optional)
If modifications to this PR may cause/fix function/accuracy/performance DTSs/issues, a self-inspection record needs to be attached.
## BC-breaking (Optional)
If there are compatibility issues, such as dependencies on cann/torch_npu versions, they need to be explained in the PR.
## Checklist
**Before PR**:
- [x] The new code needs to comply with the Clean Code specification.
- [x] The PR content is self-checked, and the expression can be clear and the writing standardized
**After PR**:
- [x] CLA has been signed and all committers have signed the CLA in this PR.
- [x] The ci-pipeline is passed, Code Check is passed.
See merge request: Ascend/MindSpeed-MM!1670
【Bugfix】Correct the spelling errors in the code
Co-authored-by: lu-jinfu1999<lujinfu1@h-partners.com>
# message auto-generated for no-merge-commit merge:
!1670 merge master into master
【Bugfix】Correct the spelling errors in the code
Created-by: lu-jinfu1999
Commit-by: lu-jinfu1999
Merged-by: ascend-robot
Description: ## Motivation
Correct the spelling errors in the code.
## Modification
Correct spelling errors in the document.
Correct spelling errors in the code.
## Self-test (Optional)
If modifications to this PR may cause/fix function/accuracy/performance DTSs/issues, a self-inspection record needs to be attached.
## BC-breaking (Optional)
If there are compatibility issues, such as dependencies on cann/torch_npu versions, they need to be explained in the PR.
## Checklist
**Before PR**:
- [x] The new code needs to comply with the Clean Code specification.
- [x] The PR content is self-checked, and the expression can be clear and the writing standardized
**After PR**:
- [x] CLA has been signed and all committers have signed the CLA in this PR.
- [x] The ci-pipeline is passed, Code Check is passed.
See merge request: Ascend/MindSpeed-MM!1670
[Feature]optimize vace fsdp2 config
Co-authored-by: feng0w0<houyufeng4@huawei.com>
# message auto-generated for no-merge-commit merge:
!1712 merge master into master
[Feature]optimize vace fsdp2 config
Created-by: feng0w0
Commit-by: feng0w0
Merged-by: ascend-robot
Description: ## Motivation
Using FSDP recomputation on the VACE model
## Modification
Modify fsdp configuration file and vace recomputee code
## Self-test (Optional)
If modifications to this PR may cause/fix function/accuracy/performance DTSs/issues, a self-inspection record needs to be attached.
## BC-breaking (Optional)
If there are compatibility issues, such as dependencies on cann/torch_npu versions, they need to be explained in the PR.
## Checklist
**Before PR**:
- [ ] The new code needs to comply with the Clean Code specification.
- [ ] The PR content is self-checked, and the expression can be clear and the writing standardized
**After PR**:
- [ ] CLA has been signed and all committers have signed the CLA in this PR.
- [ ] The ci-pipeline is passed, Code Check is passed.
See merge request: Ascend/MindSpeed-MM!1712
【Bugfix】Correct the spelling errors in the code
Co-authored-by: lu-jinfu1999<lujinfu1@h-partners.com>
# message auto-generated for no-merge-commit merge:
!1670 merge master into master
【Bugfix】Correct the spelling errors in the code
Created-by: lu-jinfu1999
Commit-by: lu-jinfu1999
Merged-by: ascend-robot
Description: ## Motivation
Correct the spelling errors in the code.
## Modification
Correct spelling errors in the document.
Correct spelling errors in the code.
## Self-test (Optional)
If modifications to this PR may cause/fix function/accuracy/performance DTSs/issues, a self-inspection record needs to be attached.
## BC-breaking (Optional)
If there are compatibility issues, such as dependencies on cann/torch_npu versions, they need to be explained in the PR.
## Checklist
**Before PR**:
- [x] The new code needs to comply with the Clean Code specification.
- [x] The PR content is self-checked, and the expression can be clear and the writing standardized
**After PR**:
- [x] CLA has been signed and all committers have signed the CLA in this PR.
- [x] The ci-pipeline is passed, Code Check is passed.
See merge request: Ascend/MindSpeed-MM!1670
[Bugfix]fix: memory reorganization during concurrent fast host dispatch and multi-stream reuse.
Co-authored-by: MoCuishle-M<1656631289@qq.com>
# message auto-generated for no-merge-commit merge:
!1750 merge master into master
[Bugfix]fix: memory reorganization during concurrent fast host dispatch and multi-stream reuse.
Created-by: MoCuishle-M
Commit-by: MoCuishle-M
Merged-by: ascend-robot
Description: ## Motivation
Fixes the memory reorganization problem triggered when fast host dispatch and tensor multi-stream reuse occur simultaneously.
当前实现因为发生内存重整，在GBS相同情况下，单步迭代时间60+ s。
回退代码后，单步迭代时间大约44 s。
在当前代码基础上，添加同步操作，单步迭代时间大约42 s。
## Modification
Please briefly describe what modification is made in this PR.
## Self-test (Optional)
If modifications to this PR may cause/fix function/accuracy/performance DTSs/issues, a self-inspection record needs to be attached.
## BC-breaking (Optional)
If there are compatibility issues, such as dependencies on cann/torch_npu versions, they need to be explained in the PR.
## Checklist
**Before PR**:
- [x] The new code needs to comply with the Clean Code specification.
- [x] The PR content is self-checked, and the expression can be clear and the writing standardized
**After PR**:
- [x] CLA has been signed and all committers have signed the CLA in this PR.
- [x] The ci-pipeline is passed, Code Check is passed.
See merge request: Ascend/MindSpeed-MM!1750
