| feat: 内存压缩特性迭代升级
Co-authored-by: NingGuangyou<ningguangyou@h-partners.com>
# message auto-generated for no-merge-commit merge:
!3173 merge master into master
feat: 内存压缩特性迭代升级
Created-by: NingGuangyou
Commit-by: NingGuangyou
Merged-by: ascend-robot
Description: 本次PR将原首节点MLP模块激活值压缩特性迭代为各节点按transformer layer激活值压缩及AdamW一二阶动量压缩,是保留原特性及使用方法不变的前提下增加了新的功能。详情可参考readme。
See merge request: Ascend/MindSpeed!3173 | 4 个月前 |