| [pytorch][sh] restore the --moe-permute-fusion parameter that was removed in Megatron r0.12.1
Co-authored-by: yanzhixiao<yanzhixiao@h-partners.com>
# message auto-generated for no-merge-commit merge:
!3555 merge add-permute-fusion-2.2.0 into 2.2.0
[pytorch][sh] restore the --moe-permute-fusion parameter that was removed in Megatron r0.12.1
Created-by: yanzhixiao23
Commit-by: yanzhixiao
Merged-by: ascend-robot
Description: [pytorch][sh] restore the --moe-permute-fusion parameter that was removed in Megatron r0.12.1
See merge request: Ascend/MindSpeed-LLM!3555 | 7 个月前 |