master

ascend-robotfeat：【FSDP backend】Change expert parallel to support combined experts weights.

eeb2f118创建于 1月14日历史提交

文件	最后提交记录	最后更新时间
__init__.py	Add MindSeed Lite Co-authored-by: JialiZheng<jializheng@huawei.com> # message auto-generated for no-merge-commit merge: !2978 merge lite into master Add MindSeed Lite Created-by: JialiZheng1 Commit-by: JialiZheng Merged-by: ascend-robot Description: Add MindSeed Lite See merge request: Ascend/MindSpeed!2978	6 个月前
dispatcher.py	feat：【FSDP backend】Change expert parallel to support combined experts weights. Co-authored-by: JialiZheng<jializheng@huawei.com> # message auto-generated for no-merge-commit merge: !3147 merge master into master feat：【FSDP backend】Change expert parallel to support combined experts weights. Created-by: JialiZheng1 Commit-by: JialiZheng Merged-by: ascend-robot Description: 修改 EP 为支持专家合并权重 eager dispatcher 精度验证: http://image.huawei.com/tiny-lts/v1/images/mdstorm/729781f03639b9a5e430e986c51fc6ee_665x772.png fused dispatcher 精度验证: http://image.huawei.com/tiny-lts/v1/images/mdstorm/52a71f80ec498d1136da7bb83b3b585d_665x770.png See merge request: Ascend/MindSpeed!3147	4 个月前
dispatcher_mc2.py	feat：【FSDP backend】Change expert parallel to support combined experts weights. Co-authored-by: JialiZheng<jializheng@huawei.com> # message auto-generated for no-merge-commit merge: !3147 merge master into master feat：【FSDP backend】Change expert parallel to support combined experts weights. Created-by: JialiZheng1 Commit-by: JialiZheng Merged-by: ascend-robot Description: 修改 EP 为支持专家合并权重 eager dispatcher 精度验证: http://image.huawei.com/tiny-lts/v1/images/mdstorm/729781f03639b9a5e430e986c51fc6ee_665x772.png fused dispatcher 精度验证: http://image.huawei.com/tiny-lts/v1/images/mdstorm/52a71f80ec498d1136da7bb83b3b585d_665x770.png See merge request: Ascend/MindSpeed!3147	4 个月前
expert_fully_shard_parallel.py	feat：【FSDP backend】Change expert parallel to support combined experts weights. Co-authored-by: JialiZheng<jializheng@huawei.com> # message auto-generated for no-merge-commit merge: !3147 merge master into master feat：【FSDP backend】Change expert parallel to support combined experts weights. Created-by: JialiZheng1 Commit-by: JialiZheng Merged-by: ascend-robot Description: 修改 EP 为支持专家合并权重 eager dispatcher 精度验证: http://image.huawei.com/tiny-lts/v1/images/mdstorm/729781f03639b9a5e430e986c51fc6ee_665x772.png fused dispatcher 精度验证: http://image.huawei.com/tiny-lts/v1/images/mdstorm/52a71f80ec498d1136da7bb83b3b585d_665x770.png See merge request: Ascend/MindSpeed!3147	4 个月前
expert_parallel.py	feat：【FSDP backend】Change expert parallel to support combined experts weights. Co-authored-by: JialiZheng<jializheng@huawei.com> # message auto-generated for no-merge-commit merge: !3147 merge master into master feat：【FSDP backend】Change expert parallel to support combined experts weights. Created-by: JialiZheng1 Commit-by: JialiZheng Merged-by: ascend-robot Description: 修改 EP 为支持专家合并权重 eager dispatcher 精度验证: http://image.huawei.com/tiny-lts/v1/images/mdstorm/729781f03639b9a5e430e986c51fc6ee_665x772.png fused dispatcher 精度验证: http://image.huawei.com/tiny-lts/v1/images/mdstorm/52a71f80ec498d1136da7bb83b3b585d_665x770.png See merge request: Ascend/MindSpeed!3147	4 个月前
utils.py	Add MindSeed Lite Co-authored-by: JialiZheng<jializheng@huawei.com> # message auto-generated for no-merge-commit merge: !2978 merge lite into master Add MindSeed Lite Created-by: JialiZheng1 Commit-by: JialiZheng Merged-by: ascend-robot Description: Add MindSeed Lite See merge request: Ascend/MindSpeed!2978	6 个月前