| fix reapeated allgather & tp2d forward_only
Co-authored-by: zhao-yifan222<17801034608@163.com>
# message auto-generated for no-merge-commit merge:
merge master into master
fix reapeated allgather & tp2d forward_only
Created-by: zhao-yifan27
Commit-by: zhao-yifan222
Merged-by: ascend-robot
Description: 1fix reapeated allgather
该问题导致moe 场景 edp>1 且开启reuse fp32时,精度有问题
2 fix tp2d forward_only 场景跑不通报错
See merge request: Ascend/MindSpeed!2854 | 8 个月前 |