| fix: Disallow use-global-aux-loss when moe-alltoall-overlap-comm is enabled
Co-authored-by: zzyyjj012<yangzj012@qq.com>
# message auto-generated for no-merge-commit merge:
!4383 merge master into master
fix: Disallow use-global-aux-loss when moe-alltoall-overlap-comm is enabled
Created-by: zzyyjj012
Commit-by: zzyyjj012
Merged-by: ascend-robot
Description:
## What this PR does / why we need it?
当use-global-aux-loss和moe-alltoall-overlap-comm同时开启时,显式抛出异常。
## Does this PR introduce any user-facing change?
无
## How was this patch tested?
关闭moe-alltoall-overlap-comm时,use-global-aux-loss可正常开启使用。打开moe-alltoall-overlap-comm时,抛出异常。
See merge request: Ascend/MindSpeed-LLM!4383 | 1 个月前 |