| register strategies for npu custom ops
Co-authored-by: jizewei<jizewei@huawei.com>
# message auto-generated for no-merge-commit merge:
!27012 merge master_register_strategy into master
register strategy for npu custom ops
Created-by: jizewei
Commit-by: jizewei
Merged-by: ascend-robot
Description: <!-- Thanks for sending a pull request!
-->
**What type of PR is this?**
> Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line:
>
> /kind bug
> /kind task
> /kind feature
/kind feature
**What does this PR do / why do we need it**:
register sharding strategies for npu custom ops to support DTensor:
1. npu_add_rms_norm
2. npu_moe_token_permute, npu_moe_token_permute_grad
3. npu_moe_token_unpermute, npu_moe_token_unpermute_grad
4. npu_rotary_mul, npu_rotary_mul_backward
**Which issue(s) this PR fixes**:
<!--
*Automatically closes linked issue when PR is merged.
Usage: Fixes #<issue number>, or Fixes (paste link of issue).
-->
Fixes #
**Special notes for your reviewers**:
See merge request: Ascend/pytorch!27012 | 6 个月前 |
