0
代码
代码
Issues
Pull Requests
讨论
Wiki
分析
0
ascend-robotascend-robotfeat: SwapMuon add save/load ckpt support
37646728创建于 12 小时前历史提交
文件最后提交记录最后更新时间
__init__.py
!2185 feat: add virtual optimizer Merge pull request !2185 from Kingsleyandher/master 1 年前
fused_ema_adamw_feature.py
!2370 fix compatibility issue between disable gloo and ema optim Merge pull request !2370 from wangyuansheng8/master 11 个月前
low_precision_optimizer_feature.py
fix: add low precision opt verification Co-authored-by: yulelanmei<huangyijie8@huawei.com> # message auto-generated for no-merge-commit merge: !3494 merge master into master fix: add low precision opt verification Created-by: yulelanmei Commit-by: yulelanmei Merged-by: ascend-robot Description: What this PR does / why we need it? The low precision optimizer features: --quant-states & --quant-grads are incompatible with --swap-optimizer, but no verification right now. Does this PR introduce any user-facing change? When user uses both parameters, a verification message is displayed. How was this patch tested? Turn on both parameters in a train script in addition. See merge request: Ascend/MindSpeed!34948 天前
muon_optimizer_feature.py
feat: add mcore muon Co-authored-by: wuweiqiang24<1005334931@qq.com> Co-authored-by: wuweiqiang24<wuweiqiang11@huawei.com> # message auto-generated for no-merge-commit merge: !3442 merge add_mcore_muon into master feat: add mcore muon Created-by: wuweiqiang24 Commit-by: wuweiqiang24 Merged-by: ascend-robot Description: 1、增加Muon优化器特性 2、Muon + TP兼容适配 3、Muon + Zero兼容适配 See merge request: Ascend/MindSpeed!34428 天前
swap_optimizer_feature.py
feat: SwapMuon add save/load ckpt support Co-authored-by: JialiZheng<jializheng@huawei.com> # message auto-generated for no-merge-commit merge: !3518 merge master into master feat: SwapMuon add save/load ckpt support Created-by: JialiZheng1 Commit-by: JialiZheng Merged-by: ascend-robot Description: SwapMuon add save/load ckpt support RFC：https://gitcode.com/Ascend/MindSpeed/issues/164 See merge request: Ascend/MindSpeed!351812 小时前
virtual_optimizer.py
!2264 fix: virtual optimizer bug fix and update doc Merge pull request !2264 from Kingsleyandher/master 1 年前