| add support for compiled autograd and simplefsdp for torchtitan
Co-authored-by: wanghonghao<wanghonghao9@huawei.com>
# message auto-generated for no-merge-commit merge:
!7540 merge compiled_autograd into master
add support for compiled autograd and simplefsdp for torchtitan
Created-by: wanghonghao
Commit-by: wanghonghao
Merged-by: ascend-robot
Description: ## Motivation
针对torchtitan Deepseek模型新增SimpleFSDP以及编译自动微分功能，完善使用资料与功能支持的代码，允许用户在torchtitan上适配compiled autograd
## Modification
新增compiled_autograd.py文件，允许用户在torchtitan上适配compiled autograd功能
## Self-test (Optional)
If modifications to this PR may cause/fix function/accuracy/performance DTSs/issues, a self-inspection record needs to be attached.
## BC-breaking (Optional)
If there are compatibility issues, such as dependencies on cann/torch_npu versions, they need to be explained in the PR.
## Checklist
**Before PR**:
- [ ] The new code needs to comply with the Clean Code specification.
- [ ] The PR content is self-checked, and the expression can be clear and the writing standardized
**After PR**:
- [ ] CLA has been signed and all committers have signed the CLA in this PR.
- [ ] The ci-pipeline is passed, Code Check is passed.
See merge request: Ascend/ModelZoo-PyTorch!7540 | 26 天前 |
