0
代码
代码
Issues
Pull Requests
讨论
Wiki
分析
0
ascend-robotascend-robotfeat: add mcore muon
d3d124c5创建于 8 天前历史提交
文件最后提交记录最后更新时间
__init__.py
feat: add mcore muon Co-authored-by: wuweiqiang24<1005334931@qq.com> Co-authored-by: wuweiqiang24<wuweiqiang11@huawei.com> # message auto-generated for no-merge-commit merge: !3442 merge add_mcore_muon into master feat: add mcore muon Created-by: wuweiqiang24 Commit-by: wuweiqiang24 Merged-by: ascend-robot Description: 1、增加Muon优化器特性 2、Muon + TP兼容适配 3、Muon + Zero兼容适配 See merge request: Ascend/MindSpeed!34428 天前
adaptor.py
feat: add mcore muon Co-authored-by: wuweiqiang24<1005334931@qq.com> Co-authored-by: wuweiqiang24<wuweiqiang11@huawei.com> # message auto-generated for no-merge-commit merge: !3442 merge add_mcore_muon into master feat: add mcore muon Created-by: wuweiqiang24 Commit-by: wuweiqiang24 Merged-by: ascend-robot Description: 1、增加Muon优化器特性 2、Muon + TP兼容适配 3、Muon + Zero兼容适配 See merge request: Ascend/MindSpeed!34428 天前
checkpointing.py
feat: add mcore muon Co-authored-by: wuweiqiang24<1005334931@qq.com> Co-authored-by: wuweiqiang24<wuweiqiang11@huawei.com> # message auto-generated for no-merge-commit merge: !3442 merge add_mcore_muon into master feat: add mcore muon Created-by: wuweiqiang24 Commit-by: wuweiqiang24 Merged-by: ascend-robot Description: 1、增加Muon优化器特性 2、Muon + TP兼容适配 3、Muon + Zero兼容适配 See merge request: Ascend/MindSpeed!34428 天前
emerging_optimizers.py
feat: add mcore muon Co-authored-by: wuweiqiang24<1005334931@qq.com> Co-authored-by: wuweiqiang24<wuweiqiang11@huawei.com> # message auto-generated for no-merge-commit merge: !3442 merge add_mcore_muon into master feat: add mcore muon Created-by: wuweiqiang24 Commit-by: wuweiqiang24 Merged-by: ascend-robot Description: 1、增加Muon优化器特性 2、Muon + TP兼容适配 3、Muon + Zero兼容适配 See merge request: Ascend/MindSpeed!34428 天前
layer_wise_optimizer.py
feat: add mcore muon Co-authored-by: wuweiqiang24<1005334931@qq.com> Co-authored-by: wuweiqiang24<wuweiqiang11@huawei.com> # message auto-generated for no-merge-commit merge: !3442 merge add_mcore_muon into master feat: add mcore muon Created-by: wuweiqiang24 Commit-by: wuweiqiang24 Merged-by: ascend-robot Description: 1、增加Muon优化器特性 2、Muon + TP兼容适配 3、Muon + Zero兼容适配 See merge request: Ascend/MindSpeed!34428 天前
muon.py
feat: add mcore muon Co-authored-by: wuweiqiang24<1005334931@qq.com> Co-authored-by: wuweiqiang24<wuweiqiang11@huawei.com> # message auto-generated for no-merge-commit merge: !3442 merge add_mcore_muon into master feat: add mcore muon Created-by: wuweiqiang24 Commit-by: wuweiqiang24 Merged-by: ascend-robot Description: 1、增加Muon优化器特性 2、Muon + TP兼容适配 3、Muon + Zero兼容适配 See merge request: Ascend/MindSpeed!34428 天前
muon_utils.py
feat: add mcore muon Co-authored-by: wuweiqiang24<1005334931@qq.com> Co-authored-by: wuweiqiang24<wuweiqiang11@huawei.com> # message auto-generated for no-merge-commit merge: !3442 merge add_mcore_muon into master feat: add mcore muon Created-by: wuweiqiang24 Commit-by: wuweiqiang24 Merged-by: ascend-robot Description: 1、增加Muon优化器特性 2、Muon + TP兼容适配 3、Muon + Zero兼容适配 See merge request: Ascend/MindSpeed!34428 天前
optimizer_config.py
feat: add mcore muon Co-authored-by: wuweiqiang24<1005334931@qq.com> Co-authored-by: wuweiqiang24<wuweiqiang11@huawei.com> # message auto-generated for no-merge-commit merge: !3442 merge add_mcore_muon into master feat: add mcore muon Created-by: wuweiqiang24 Commit-by: wuweiqiang24 Merged-by: ascend-robot Description: 1、增加Muon优化器特性 2、Muon + TP兼容适配 3、Muon + Zero兼容适配 See merge request: Ascend/MindSpeed!34428 天前
optimizer_param_scheduler.py
feat: add mcore muon Co-authored-by: wuweiqiang24<1005334931@qq.com> Co-authored-by: wuweiqiang24<wuweiqiang11@huawei.com> # message auto-generated for no-merge-commit merge: !3442 merge add_mcore_muon into master feat: add mcore muon Created-by: wuweiqiang24 Commit-by: wuweiqiang24 Merged-by: ascend-robot Description: 1、增加Muon优化器特性 2、Muon + TP兼容适配 3、Muon + Zero兼容适配 See merge request: Ascend/MindSpeed!34428 天前
orthogonalized_optimizer.py
feat: add mcore muon Co-authored-by: wuweiqiang24<1005334931@qq.com> Co-authored-by: wuweiqiang24<wuweiqiang11@huawei.com> # message auto-generated for no-merge-commit merge: !3442 merge add_mcore_muon into master feat: add mcore muon Created-by: wuweiqiang24 Commit-by: wuweiqiang24 Merged-by: ascend-robot Description: 1、增加Muon优化器特性 2、Muon + TP兼容适配 3、Muon + Zero兼容适配 See merge request: Ascend/MindSpeed!34428 天前
param_and_grad_buffer.py
feat: add mcore muon Co-authored-by: wuweiqiang24<1005334931@qq.com> Co-authored-by: wuweiqiang24<wuweiqiang11@huawei.com> # message auto-generated for no-merge-commit merge: !3442 merge add_mcore_muon into master feat: add mcore muon Created-by: wuweiqiang24 Commit-by: wuweiqiang24 Merged-by: ascend-robot Description: 1、增加Muon优化器特性 2、Muon + TP兼容适配 3、Muon + Zero兼容适配 See merge request: Ascend/MindSpeed!34428 天前
utils.py
feat: add mcore muon Co-authored-by: wuweiqiang24<1005334931@qq.com> Co-authored-by: wuweiqiang24<wuweiqiang11@huawei.com> # message auto-generated for no-merge-commit merge: !3442 merge add_mcore_muon into master feat: add mcore muon Created-by: wuweiqiang24 Commit-by: wuweiqiang24 Merged-by: ascend-robot Description: 1、增加Muon优化器特性 2、Muon + TP兼容适配 3、Muon + Zero兼容适配 See merge request: Ascend/MindSpeed!34428 天前